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Cove7 eg77o7: Formula for the 7 Fibonacci number. Exercise 21 in Section SD 
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You are probably about to begin your second exposure to linear aleebra. Unlike 
your frst brush with the subject, which probably emphasized Euclidean spaces 
and matrices, this encounter will focus on abstract vector spaces and Hinear maDps. 
These terms will be defined later, so don't worry if you do not know what they 
mean. This book starts from the begsinning of the subject, assuming no knowledge 
of inear algebra. The key point is that you are about to immerse yourself in 
serious mathematics, with an emphasis on attaining a deep understanding of the 
definitions, theorems, and proofs. 

You cannot read mathematics the way you read a novel. you zip through a 
page in less than an hour, you are probably going too fast. When you encounter 
the phrase “as you should verify') you should indeed do the verification, which 
will usually require some writing on your part. When steps are left out, you need 
to supply the missing pieces. You should ponder and internalize each definition. 
For each theorem, you should seek examples to show why each hypothesis is 
necessary. Discussions with other students should help. 

As a visual aid, definitions are in yellow boxes and theorems are in blue boxes 
(in color versions of the book). Each theorem has an infomal descriptive name. 

Please check the website below for additional information about the book, 
including a link to videos that are freely available to accompany the book. 

Your suggestions, comments, and corrections are most welcome. 

Best wishes for success and enjoyment in learning linear algebra! 


Sheldon Axler 
San Francisco State University 


website: https://Hinear.axler.net 
e-mail: inear@axlernet 
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You are about to teach a course that will probably give students their second 
exDOSure to linear algebra. During their frst brush with the subject, your students 
probably worked with Eucidean spaces and matrices. In contrast, this course wi 
emphasize abstract vector spaces and Inear maDs. 

The ttle of this book deserves an explanation. Most linear algebra textbooks 
use determinants to prove that every hnear operator on a fimite-dimensional com- 
plex vector space has an eieenvalue. Determinants are dificult, nonintuitive, 
and often defimed without motivation. To prove the theorem about existence of 
eieenvalues on complex vector sDaces, most books must defimne determinantSs, 
prove that a hnear operator is not invertible if and only 下 its determinant equals 0, 
and then define the characteristic polynomial. This tortuous (torturous?) path 
gives students Hittle feeling for why eigenvalues exist. 

In contrast, the simple determinant-free proofs presented here (for example, 
see 5.19) offer more insight. Once determinants have been moved to the end of 
the book, a new route opens to the main goal of linear algebra 一 understanding 
the structure of linear operators. 

This book starts at the beginning of the subject, with no prereduisites other 
than the usual demand for suitable mathematical maturity. A few examples 
and exercises involve calculus concepts such as continuity, differentiation, and 
integration. You can easily skip those examples and exercises if your students 
have not had calculus. f your students have had calculus, then those examples and 
exercises can enrich their experience by showing connections between different 
parts of mathematics. 

Even if your students have already seen some of the material in the first few 
chapters, they may be unaccustomed to working exercises of the type presented 
here, most of which require an understanding of proofs. 

Here is a chapter-by-chapter summary of the highlights of the book: 


e Chapter 1: Vector spaces are defined in this chapter, and their basic properties 
are developed. 


e Chapter 2: Linear independence, span, basis, and dimension are defined in this 
chapter, which presents the basic theory of fimite-dimensional vector spaces. 


es Chapter 3: This chapter introduces Hnear maps. The key result here is the 
fundamental theorem of linear maps: ザ 了 is a linear map on then dim ソ = 
dimnull ア + dimrange 7 Quotient spaces and duality are topics in this chapter 
at a higher level of abstraction than most of the book: these topics can be 


Skipped (except that duality is needed for tensor products in Section 9D). 
xii 
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e Chapter 4: The part of the theory of polynomials that will be needed to un- 
derstand Iinear operators is presented in this chapter. This chapter contains no 
jinear alsebra. It can be covered quickIy, especially if your students are already 
familiar with these results. 


es Chapter 5: The idea of studying a Hinear operator by restricting it to small sub- 
Spaces leads to eigenvectors in the early part of this chapter. The hishlight of this 
chapter is a simple proof that on complex vector SDaces, eigenValues alWays eX- 
ist. This result is then used to show that each linear operator on a complex vector 
Space has an upper-triangular matrix with respect to some basis. The minimal 
polynomial plays an importantrole here and later in the book. For example, this 
chapter gives a characterization of the diagonalizable operators in terms of the 
minimal polynomial. Section SE can be skipped if you want to save some time. 


es Chapter 6: Inner product spaces are defined in this chapter, and their basic 
properties are developed along with tools such as orthonormal bases and the 
Gram-Schmidt procedure. This chapter also shows how orthogonal projectons 
can be used to solve certain minimization problems. The pseudoinverse is then 
introduced as a useful tool when the inverse does not exist. The material on 
the pseudoinverse can be skipped i you want to save some time. 


e Chapter 7: The spectral theorem, which characterizes the linear operators for 
which there exists an orthonormal basis consisting of eigenvectors, 1s one of 
the highlights of this book. The work in earlier chapters pays of here with espe- 
cially simple proofs. This chapter also deals with positive operators, isOometries, 
unitary operators, matrix factorizations, and especially the singular value de- 
composition, which leads to the polar decomposition and norms of linear maps. 


e Chapter 8: This chapter shows that for each operator on a complex Vector SDaCe, 
there is a basis of the vector space consisting of generalized eigenvectors of the 
operator. Then the generalized eigenspace decomposition describes a linear 
operator on a complex vector space. The multiplicity of an eigenvalue is defined 
as the dimension of the corresponding generalized eigenspace. These tools are 
used to prove that every invertible linear operator on a complex vector spDace 
has a square root. Then the chapter gives a proof that every Hinear operator on 
a complex vector space can be put into Jordan form. The chapter concludes 
with an investigation of the trace of operators. 


es Chapter 9: This chapter begins by looking at bilinear forms and showing that the 
Vector space Of bilinear forms is the direct sum of the subspaces of symmetric 
bilinear forms and alternating bilinear forms. Then quadratic forms are diag- 
onalized. Moving to multilinear forms, the chapter shows that the subspace of 
alternating 7-Hnear forms on an 7-dimensional vector space has dimension one. 
This result leads to a clean basis-free defimition of the determinant of an opera- 
tor. For complex vector spaces, the determinant turns out to equal the product of 
the eigenvalues, with each eigenvalue included in the product as many tmes as 
its multiplicity. The chapter concludes with an introduction to tensor products. 
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This book usually develops Hnear algebra simultaneously for real and complex 
vector spaces by lettingF denote either the real or the complex numbers. If you and 
your students prefer to think of F as an arbitrary field, then see the comments at the 
end of Section 1A. 1 prefer avoiding arbitrary fields at this level because they intro- 
duce extra abstraction without leading to any new hnear algebra. Also, students are 
more comfortable thinking of polynomials as functions instead of the more formal 
objects needed for polynomials with coefhcients in finite fields. Finally, even the 
beginning part of the theory were developed with arbitrary fields, inner product 
Spaces Would push consideration back to just real and complex Vector sDaces. 

You probably cannot cover everything in this book in one semester. Going 
through all the material in the first seven or eight chapters during a one-semester 
course may reduire a rapid pace. If you must reach Chapter 9, then consider 
skipping the material on quotient spaces in Section 3E, skipping Section 3F 
on duality (unless you intend to cover tensor products in Section 9D), covering 
Chapter 4 on polynomials in a half hour, skipping Section SE on commuting 
operators, and skipping the subsection in Section 6C on the pseudoinverse. 

A goal more important than teaching any particular theorem is to develop in 
students the ability to understand and manipulate the objects of hnear algebra. 
Mathematics can be learned only by doing. Fortunately, linear alsebra has many 
good homework exercises. When teaching this course, during each class Tusually 
assigen as homework several of the exercises, due the next class. Going over the 
homework might take up significant time in a typical class. 

Some of the exercises are intended to lead curious students into important 
topics beyond what might usually be included in a basic second course in hnear 
algebra. 


The author*s top ten 


Listed below are the author's ten favorite results in the book, in order of their 
appearance in the book. Students who leave your course with a good understanding 
of these crucial results will have an excellent foundation in linear algebra. 


e any tyo bases of a Vector space have the same length (2.34) 

e fundamental theorem of linear maps (3.21) 

e existence Of eigenvalues ifF = C(S5.19) 

e upDper-triangular form always exists ifF =C(5.47) 

e Cauchy-Schwarz ineduality (6.14) 

e Gram-Schmidt procedure (6.32) 

e SDectral theorem (7.29 and 7.31) 

e singular value decomposition (7.70) 

e generalized eigenspace decomposition theorem whenF =C (8.22) 


e dimension of alternating 7-linear forms on Vis 1ifdim ソ = ァ 7(9.37) 
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Major improvements and additions for the fourth edition 


Over 250 new exercises and over 70 new examples. 


Increasing use of the minimal polynomial to provide cleaner proofs of multple 
results, including necessary and sufhicient conditions for an operator to have an 
upper-triangular matrix with respect to some basis (see Section 5 〇 ), necessary 
and sufficient conditions for diagonalizability (see Section 5D), and the real 
spectral theorem (see Section 7B). 


New section on commuting operators (see Section 5E). 
New subsection on pseudoinverse (see Section 6 〇 ). 
New subsections on OR factorization/Cholesky factorization (see Section 7D). 


Singular value decomposition now done for linear maps from an inner product 
Space to another (possibly different) inner product space, rather than only deal- 
ing with hnear operators from an inner product space to itself (see Section 7E). 


Polar decomposition now proved from singular value decomposition, rather than 
in the opposite order: this has led to cleaner proofs of both the singular value 
decomposition (see Section 7E) and the polar decomposition (see Section 7F). 


New subsection on norms of Hinear maps on finite-dimensional inner prod- 
uct spaces, Using the singular value decomposition to avoid even mentioning 
Supremum in the definition of the norm of a linear map (see Section 7F). 


New subsection on approximation by Hinear maps with lower-dimensional range 
(see Section 7F). 


New elementary proof of the important result that ザ 了 is an operator on a fmite- 
dimensional complex Vector space then there exists a basis of V consisting 
of generalized eigenvectors of 7 (see 8.9). 


New Chapter 9 on multilinear algebra, including bihnear forms, quadratic 
forms, multilinear forms, and tensor products. Determinants now are defined 
using a basis-free approach via alternating multilinear forms. 


New formatting to improve the student-friendly appearance of the book. For 
example, the definition and result boxes now have rounded corners instead of 
right-angle corners, for a gentler look. The main font size has been reduced 
from 11 point to 10.3 point. 


Please check the website below for additional links and information about the 


book. Your suggestions, comments, and corrections are most welcome. 


Sheldon Axler 
San Francisco State University 


Best wishes for teaching a successful linear algebra class! 
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Iowe a huge intellectual debt to all the mathematicians who created Hinear alsebra 
over the past two centuries. The results in this book belong to the common heritage 
of mathematics. A special case of a theorem may frst have been proved long ago, 
then sharpened and improved by many mathematicians in different time periods. 
Bestowing proper credit on all contributors would be a difcult task that 1 have 
not undertaken. In no case should the reader assume that any result presented 
here represents my original contribution. 

Many people helped make this a better book. The three previous editions of 
this book were used as a textbooK at over 37S universities and colleges around 
the world. Ireceived thousands of suggestions and comments from faculty and 
students who used the book. Many of those suggestions led to improvements 
in this edition. The manuscript for this fourth edition was class tested at 30 
universities. 1 am extremely grateful for the useful feedback that Ireceived from 
faculty and students during this class testing. 

The lons Hist of people who should be thanked for their suggestions would 
fll up many pages. Lists are boring to read. Thus to represent all contributors 
to this edition, T will mention only Noel Hinton, a sgraduate student at Australian 
National University, who sent me more suggestions and corrections for this fourth 
edition than anyone else. To everyone who contributed suggestions, let me say 
how truly grateful 1 am to all of you. Many many thanks! 

1 thank Springer for providing me with help when Ineeded it and for allowing 
me the freedom to make the final decisions about the content and appearance 
of this book. Special thanks to the two terrific mathematics editors at Springer 
who worked with me on this project- 一 Loretta Bartolini during the frst half of 
my work on the fourth edition, and Elizabeth Loew during the second half of my 
work on the fourth edition. 1 am deeply indebted to David Kramer, who did a 
magnificent job of copyediting and prevented me from making many mistakes. 

Extra special thanks to my fantastic partner Carrie Heeter. Her understanding 
and encouragement enabled me to work intensely on this new edition. Our won- 
derful cat Moon, whose picture appears on the 4 の oz7 77e 4777o7 Dage, Drovided 
Sweet breaks throughout the writing process. Moon died suddenly due to a blood 
clot as this book was being finished. We are grateful for five precious years with 
him. 


Sheldon Axler 
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Chapter 1 ED 
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Linear algebra is the study of Hinear maps on finite-dimensional Vector sDaces. 
Eventually we will learn what all these terms mean. In this chapter we will define 
Vector spaces and discuss their elementary DrODerties. 

Im iinear algebra, better theorems and more insight emeree if complex numbers 
are investigated along with real numbers. Thus we will begin by introducing the 
complex numbers and their basic properties. 

We will generalize the examples of a plane and of ordinary spacetoR" and 
C7 which we then will generalize to the notion of a vector space. As we will see, 
a Vector space is a set with operations of addition and scalar multiplication that 
satisfy natural algebraic properties. 

Then our next topic will be subspaces, which play a role for vector spaces 
analogous to the role played by subsets for sets. Finally, we will look at sums 
of subspaces (analogous to unions of subsets) and direct sums of subspaces 
(analogous to unions of disjoint sets). 
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You should already be familiar with basic properties of the set R ofreal numbers. 
Complex numbers were invented so that we can take square roots of negative 
numbers. The idea is to assume we have a square root of 一 1, denoted by ヵ that 
obeys the usual rules of arithmetic. Here are the formal definitions. 


1.1 definition: co7//er 77777 の e75, 


e A co7/er 7777 の e7 1S an ordered pair (2, り ), where 2, ち  R, but we will 
write this asg7 二 の . 


e The set of all complex numbers is denoted by C: 


C={(2+ ナ の: の ビ R). 


e 472777 の 7 and 777 の 7cg77o7 On C are defined by 


(2 の ) 二 (c 二 大) ニ (47+C) 二 (5 二 の 4 
(2 二 7)(c+ の ) ニ (24c 一 の ) 十 (27 + /) ヵ 


here 7,,c,7  R. 


HffzR,weidentifyg+ 07 with the real numberg. Thus wethinkofRasa 
subset of C. We usually write 0+asjust の 7, and we usually write 0+17 as just7. 
To motivate the definitionofcomplex 7Z。 76D07 7 WO rf 567 7O の en 


multiplication given above, pretendthat  、ー ィ の /eorg77 太 er 如 777Z 
we knew that 7 だ = 1 and then use the 


usual rules of arithmetic to derive the formula above for the product of two 
complex numbers. Then use that formula to verify that we indeed have 


72 ニー1. 


Do not memorize the formula for the product of two complex numbers 一 you 
can always rederive it by recalling that だ = 1 and then using the usualrules of 
arithmetic (as given by 1.3). The next example illustrates this procedure. 


1.2 example: co7 の /ex g7777777767 


The product (2+ 3)(4+ 57) can be evaluated by applying the distributive and 
commutative propertes from 1.3: 
(2+ 3 の (4 +57) = 2・(4 5 の (3)(4 二 5 が 
三 2・4+2・57 二 37・4+ (37(57) 
=8+107+127 一 15 
ニーZ + 227. 
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Our frst result states that complex addition and complex multiplication have 
the familiar properties that we expect. 


1.3 7O/6777esy の 7 co77//er 77777777677C 


commutativitY 
%+p ニ p+Twandwp= ニ /wforallw.p と で C. 


aSsociativity 
(*+ と) エル ニル w+(+ 和 ) and (w8) ル ん = (人 for all w, ん で . 


identities 
ルル +0= ニ ル andA1= ニ AforalA ル EC. 


additive inverse 
For every w  C, there exists a uniguepCsuchthatz+p=0. 


multiplicative inverse 
ForeverywCwithw 也 0,there exists a unigue と Csuchthatw2 =1. 


distributive property 
A(w+ ) = Aw+ AforallA ん ep 己 C. 


The properties above are proved using the famihiar properties of real numbers 
and the definitions of complex addition and multiplication. The next example 
shows how commutativity of complex multiplication is proved. Proofs of the 
other properties above are left as exercises. 


1.4 example: co77774777D77y の 7 CO777 の 7 7277777 の 77C77O7 


To show that w8 = pe for all w, 2 ビ C, suppose 
% 三 g+ and =c+ の , 


where 2, ち Cc R. Then the definition of multiplication of complex numbers 
shows that 


wp = (2 二 婦 )(c 二 の) 
三 (gc 一 婦 ) + (29+ DC)7 


and 


gw (C+ の )(2+ 女 ) 
三 (cg 一) + (cb+ 7)7. 


The equations above and the commutativity of multiplication and addition of real 
numbers show that wp = pe み . 
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Next, we defime the additive and multiplicative inverses of complex numbers, 
and then use those inverses to define subtraction and division operations with 
complex numbers. 


1.5 gefinition: 一 w, y/ の 7 の c7O7, 1/, の 757O7 


Suppose e, p 己 C. 


e Let 一 w denote the additive inverse of w. Thus 一 is the unique complex 
number such that 
ルル 十 (一 w) = 0. 


e 5 の 7oc7o7 On C is defined by 
一 ニル P 二 ( 一 め ). 


e Eorz 子 0,let 1/z and = denote the multiplicative inverse of w. Thus 1/z is 
the unique complex number such that 


(7704) 攻 王 間 上 


e Forw チ 0, の rs7o7 by z is defined by 
p/w = が (1/). 


So that we can conveniently make definitions and prove theorems that apply 
to both real and complex numbers, we adopt the following notation. 


Thus if we prove a theorem involving 
F, we will know that it holds when F is 
replaced with R and when F is replaced 
with で . 

Elements of F are called scg/27y. The word “scalar'” (which is just a fancy 
word for "number”) is often used when we want to emphasize that an object is a 
number, as OpDposed to a vector (Vectors will be defmed soon). 

ForwFand7za positive integer, we define w" to denote the product of w 
with itself 77 tmes: 


77e /e77e7 F 7y ye の ecgye R g7 の C 
G7e eX77 の /es O7 777 76 C//cg 77e/7. 


ルル 7 ーー ル …. 
ーー ンー ン 
77 times 


This definition implies that 
(MO 三 加 7 amnd (AD の 


forallz,p ヒ Fandall positive integers 77, 7. 
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757y 


Before defining R" and C? we look at two important examples. 


1.7 example: R< gz R? 


e The set R^2 which you can think of as a plane, is the set of all ordered pairs of 
real numbers: 
R2 = {xy の) : 7 R). 


e The set R? which you can think of as ordinary space, is the set of all ordered 
triples of real numbers: 
R? ={((% め 2) の 2R). 


To generalize R< and R? to higher dimensions, we first need to discuss the 
conceDt Of ]ists. 


1.8 definition: 7 が s7 7e7g 太 


e SuDDOSe 77 1S a nonnegative integer. A /7s7 of /e7zg77 7 1S an ordered collec- 
tion of 7 elements (which might be numbers, other lists, or more abstract 
objects). 


e Two HiSts are equal if and only they have the same length and the same 
elements in the same order. 


Lists are often written as elements 
separated by commas and surrounded by 
parentheses. Thus a Hst of length two is 
an ordered pair that misht be written as (2, の ). A Hst of length three is an ordered 
triple that might be written as (*,Z). A Hst of length ヵ might look Hike this: 


427 7 が 770e772477C7729 Cg7/7 の /7y7 の 7 
/e7,g777 7 7 7-777 の /6. 


(1。m ち 5 )、 

Sometimes we will use the word /7s7 without specifying its length. Remember, 
however, that by definition each list has a finite length that is a nonnegative integer. 
Thus an object that looks like (*」,*。, …… ), which might be said to have infinite 
length, is not a Hst. 

A list of length 0 looks like this: ( ). We consider such an object to be a Hst 
so that some of our theorems will not have trivial exceptions. 

Lists differ from sets in two ways: in lists, order matters and repetitions have 
meaning: in sets, order and repetitions are irrelevant. 


1.9 example: /7 が 7S ve7rS74y Se が な 


e The jists (3,5) and (5,3) are not equal, but the sets {3,5} and {5, 3} are equall. 


e The lists (4,4) and (4,4,4) are not equal (they do not have the same length)), 
although the sets {4,4) and {4, 4,4) both equal the set {4). 
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FE 


To define the higher-dimensional analogues of R< and R3 we will simply replace 
R with F (which equals R or で ) and replace the 2 or 3 with an arbitrary positiVe 
1nteger. 


E7 is the set of all Hists of length 7 of elements of F: 
RI 二 (EE ei22 ル BC LOTN/ 三 紳 時 博 寺 7 


For (*」,…,,) 三 F” and た 代 ,…,7, we say that *, 1s the 5 coo77777e Of 
(5 


Hf ギー=Rand ヵ equals 2 or 3, then the definition above ofF" agrees with our 
previous notions of R^ andR> 


1.12 example: で * 


C3 is the set of all lists of four complex numbers: 


4 ・ 
C ヒー {(Z1,Z2, 23, Z4) ロ る 1 2> る 3 ぅ 4 ビ Ci. 


5 = MM MNO NN RP as eg 772777777・ 人 4 oO72772ce 0/ 77y 
physical object. Similarly,C”can be の 訪 ezszos, の y Ep 4. 4 の Po 7 
thought of as a plane, but for カ > 2。the sg gcco777 の 7 7ow R3 yeo/ 


human brain cannot provide a fullimage jepezcepe7 の cyeg77es 7 が yg 7 R2 
of CHowever, even if 7 iS large. We 77js ove/ pg の 7 が s カ eg の 7 788 7gy 
can perform algebraic manipulationsin 7e か yoz7 娘 22g7e の ys7cG7 spgce o/ 
F7 as easily as in R< or R? For example。 ro7 77O7e の 7e7757O775。 

addition in F" is defined as follows. 


4427 が o7 in F" is defined by adding corresponding coordinates: 


(eo) 二 ( の p っ の ) (ばっ 填 放 )- 


Often the mathematics ofF" becomes cleaner if we use a single letter to denote 
alist of 7 numbers, without explicitly writing the coordinates. For example, the 
next result is stated with * andyinF" even though the proof requires the more 
cumbersome notation of (Y],…,) and (の, っ) 
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1.14 co77727777v77 の 7 777o77 777 F7 


Tf ァ 7 三 then を リリ ニキ オア. 


Proof Suppose * = (っ ) FE7 and テ (の っ) FT Then 
オリ (1) っ) 十 (> ) 
三 ( え ] ライ 十 攻 ,) 
三 (上 寺 ])…>7 十 そ ) 
(ーッ 填 (Y]…。 そ 。) 
ニー 


where the second and fourth equalities above hold because of the definition of 
addition in F" and the third equality holds because of the usual commutativity of 
addition inF. 


TIf a single letter is used to denote an 
element of F7 then the same letter with 
apDropriate subscripts is often used when 
coordinates must be displayed. For example, 半 x  F'* then letting x equal 
(Y],…,%) 1S good notation, as shown in the proof above. Even better, work with 
just x and avoid explicit coordinates when possible. 


77e sy77 の o7 1 726749 “"e7 の の 7 /7oo/ " 


1.15 notation: 0 


Let 0 denote the Hist of length 7 whose coordinates are all 0: 


0 三 0L。a 0 


Here we are using the symbol 0 in two different ways 一 -on the left side of the 
eduation above, the symbol 0 denotes a Hst of length ヵ , which is an element of F* 
whereas on the right side, each 0 denotes a number. This potentially confusing 
practice actually causes no problems because the context should always make 
clear which 0 is intended. 


1.16 example: co77ex7 の e7e77777776 77c7 0 7 が 5 7777e777e の 


Consider the statement that 0 is an additive identity for F": 
*+0=x foralrcE" 


Here the 0 above is the list defined in 1.15, not the number 0, because we have 
not defined the sum of an element of F" (namely, ) and the number 0. 
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A picture can aid our intuition. We will 
draw pictures in R^ because we can sketch (@%. の 
this space on two-dimensional surfaces 
such as paper and computer screens. A 
typical element ofR2 isapointo = (2, の . 
Sometimes wethink ofonotasapoint ! 
but as an arrow starting attheoriginand 女 eens の R<cgn pe 放 oeg77 が 
ending at (7, の, as shown here. When we 5 の 7727S 07 95 VeC7O7 ぶ 、 
think of an element of R< as an arroW, we 
refer to 1t as a vec/7 の 7. 

When we think of Vectors in R< as arrows,。 we 
can move an arrow parallel to itself (not changing 
its length or direction) and still think of it as the M 
same Vector. With that viewpoint, you will often 
gain better understanding by dispensing with the 
coordinate axes and the explicit coordinates and 4 vec7o た 
Just thinking of the vector, as shown in the figure here. The two arrows shown 
here have the same length and same direction, so we think of them as the same 
Vector. 


・ ・ 2 
Whenever we use pictures in RT or 74777e774477cG/ 7 の 7e/5 の 7 77e eco77 の 77 ア 


use the somewhat Vague language of cg72 7 の ve 777O4y の 7 の 9 の 7 Ug77 の の /es, yy 
points and vectors, remember that these roow 太 7 eg の 25 吉 7 ve 777757 


are just aids tO Our understanding, not sub- jo 訪 R5000 Sc7 の spgce cg7707 の e 
stitutes for the actual mathematics that geg/7wz geo7ze77cg7, 万 eve: e 
we will develop. Although we cannot 2Z/gep7g/c PP7 の gc YO75 rpe77. 777y 
draw good pictures in hisgh-dimensional os の /ec7 7 cg77eg /77zeg7 6/ge の 7g. 
SDaces, the elements of these spaces are 

as rigorously defined as elements of R^ 

For example, 避 ー3, 17, 7 V2) is an element of R? and we may casually 
refer to it as a point in R? or a vector in R? without worrying about whether the 
geometry of R? has any physical meaning. 

Recall that we defined the sum of two elements of F" to be the element of F" 
obtained by adding corresponding coordinates: see 1.13. As we will now see, 
addition has a simple geometric interpretation in the special case of R^ 

Suppose we have two vectors z andoin R2< の 
that we want to add. Move the vector o parallel 


to itself so that its initial point coincides with the 

end point of the vector z。 as shown here. The りき 
sumz+ の then equals the vector whose initial 

point equals the initial point of 7 and whose end 

point equals the end point of the Vector ?, as 77e sz777 の れ YO YeC7 の 7' ゞ . 


Shown here. 
In the next definition, the 0 on the right side of the displayed equation is the 
Hist0 EE 


Section 1A Rand Cr 9 


1.17 definition: de 72ve7rye 7 7 一 テ 


For x と F" the 477ye 7 が ye7rye of *, denoted by 一 x, is the vector 一 x  F" 
such that 
ィ 二 (一 Y) 三 0. 


NNUSIUI0 当 三 和 GT の 2UUUGIUE=2 王 (に 015SetesA り 


The additive inverse of a vector in R< is the 
Vector with the same length but pointing in the ニー 
opposite direction. The figure here illustrates 
this way of thinking about the additive inverse 
in R< As you can see, the vector labeled x has 
the same length as the vector labeled x but points 4 Vec7o7 7 7 が 5 77Zve 77Ve7Se. 
in the opposite direction. 

Having dealt with addition in F*” we now turn to multiplication. We could 
define a multiplication in F" in a similar fashion, starting with two elements of 
F" and getting another element of F" by multiplying corresponding coordinates. 
Experience shows that this definition is not useful for our purposes. Another 
type of multplication, called scalar multiplication, will be central to our subject. 
Specifically, we need to define what it means to multiply an element ofF" by an 
element of F. 


1.18 definition: ycg/27 774777p/7c77O7 777 F" 


The p7ogzc7 of a number and a vector in F” is computed by multiplying 
each coordinate of the Vector by ん : 


AU に BEP ツー AP 2A2 


here ん and (?」,…,y。) FT 


Scalar multiplication 8 TICC SPOT Scg/7 7 の fcg77o7 77 F" 7 の /7ey 
metric interpretation in R2ITA>0and 7 の ge77er @ co7g7 の 2 g vec の 7 8e7777g 


RS then Aris the vector that points ecyoz co77757 7e の o7 7 の gzc7 7 
in the same direction as x and whose  R2 7 R3 7p/7es 7oge7e7 PO vec- 
length is 人 ル times the length of ry. In other 7 の 7y 7 の ge7S 7 KYg27/274 二 9 ぐ 72/7242777277727/ 人 ん 】 
words, to get Ax, we shrink or stretchx  o7 娘 eo7p7ogc7 777 の eco7ze 777PO た 
by a factor of , depending on whether 7277 Cgp7er 6. 
ル <1or ル >1. 

IfA<0andx と RS< then Ax is the 
vector that points in the direction opposite 
to that of x and whose length is |A| times 
the length of xr, as shown here. 3 / 


Scg/47 774777 の 77c77O77. 
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の 7g7ess7O77 の 7 7e/75 


A 77e/7 is a set containing at least two distinct elements called 0 and 1, along with 
operations of addition and multiplcation satisfying all properties listed in 1.3. 
Thus R and C are fields, as is the set of rational numbers along with the usual 
operations of addition and multplication. Another example of a field is the set 
{0, 1) with the usual operations of addition and multplication except that1+1is 
defined to equal 0. 

In this book we will not deal with fields other than R and C. However, many 
of the definitions, theorems, and proofs in linear alsebra that work for the fields 
R and C also work without change for arbitrary fields. Tf you prefer to do so, 
throughout much of this book (except for Chapters 6 and 7, which deal with inner 
product spaces) you can think of F as denoting an arbitrary field instead of R 
or C. For results (except in the inner product chapters) that have as a hypothesis 
that F is で , you can probably replace that hypothesis with the hypothesis that F 
is an algebraically closed field, which means that every nonconstant polynomial 
with coef 抽 cients in F has a zero. A few results, such as Exercise 13 in Section 
1C, require the hypothesis onFthat1+1 デ 0. 


re7c7yey 7 ん 


1 Showthatz+p= ニ p+eforalw.6 ヒ EC. 


2 Showthat(w+ 5) エル = ニル w+(8+)forallzw. 8 ん と C. 
3 Show that (w8) ん = w(8A) for all w, 8 ん で. 
4 Show that A(x+p) = Ag+Aforall 4 で . 
S Show that for every e と C, there exists a uniguepCsuchthatg+=0. 
6 ShowthatforeverywCwithz 子 0,there exists a unidue pj ヒ Csuch 
that wp =1. 
7 Show that 
ー1+ V37 
2 


is a cube root of 1 (meaning that its cube equals 1). 
S HBind two distinct square roots of 7. 
9 Eindx 三 RT such that 
(4, 一 3, 1,7) + 2r = (5,9, 一 6,8). 
10 Explain why there does not exist ル と C such that 


ル ん (2ー35+47 一 6+77) ニ (12 一 57.7+ 227, 一 32 一 9). 
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11 Show that (x+ の キッ ニャ +(+ ッ ) forallrzE" 

12 Show that (4 の = g(y) for allx EEF"and all2. ち EE. 

13 Showthat lx =xforallxeE' 

14 Show that え (+y) ニ 4Y+Ayforal ル AEFandalryEF" 


1S Showthat 4+ す の x ニ gy+Dxforall7 り と FandallyEE 


“Can you do addition7” the White Queen asked. “What's one and one and one 
and one and one and one and one and one and one and one?" 
“dont know,” said Alice. “1 1ost count.” 


一 777ozg7 7 が e oo 刀 77g /gss, Lewis Carroll 
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7 の ge/77777o77 の 7 Vec7o7 Sgc6e 


The motivation for the definition of a vector space comes from properties of 
addition and scalar multiplication in F": Addition is commutatiVe, assOciatiVe, 
and has an identity. Every element has an additive inverse. Scalar multiplication 
is associative. Scalar multiplication by 1 acts as expected. Addition and scalar 
multiplication are connected by distributive properties. 

We will define a vector space to be a set " with an additon and a scalar 
multplication on that satisfy the properties in the paragraph above. 


1.19 definition: 7777, scg/7 7777777 の /7C77 の 7 


e Angg777o7 On a set Vis a function that assigns an elementg+ の ソ 
to each pair of elements ヵ , の と 


e 人 A scg/7 277 の 7cg7 が 7 On a set is a function that assigns an element 
AoVtoeach ん AEFandeacho と V 


Now we are ready to give the formal definition of a vector space. 


1.20 definition: vec7O7 DCe 


Avec7o7 sy の gceisaset V along with an addition on and a scalar multiplication 
on such that the following properties hold. 
commutativitY 
嫌 二 の ニ の +zforall7o と ば 
aSsociativity 
(2 二 の ) 二 の 三 74 十 (の? 十 ⑦) and (の) の = g(/ の ) for all 7, の, の ヒ げ and for all 
の F. 
additive identity 
There exists an element0 と Vsuchthato+0=oforallo と 


addifive inverse 
For everyo と ゆ there exists suchthat の o+ の =0. 


multiplicative identity 
1o =?forallo と 


distributive properties 
(4 二 の ) 三 g747 十 の の and (4 の り ? ニ go の o+ の forallz7,p と Fandallzo の と 


The following geometric 1anguage sometimes aids our intuition. 


1.21 definition: vec7 の 7 の 7777 


Elements of a vector spDace are called vec7o7 ゞ Or po7775. 
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The scalar multiplication in a Vector space depends on F. Thus when we need 
to be precise, we will say that is a vec7o7 spgce over F instead of saying simply 
that is a Vector space. For example, R" is a vector space over R,andC"isa 
Vector sDace over C. 


1.22 definition: 7eg/ vec7 の 7 DC6, CO777 の /6r VeC7O7 ゞ DC@6 


e 人 A Vector SDace Over R is called a 7eg/ vec7 の 7 SC6. 


e 人 A vector SDace OVer C is called a co7//ex vec7 の 7 ? の 9C6. 


Usually the choice ofF is either clear from the context or irrelevant. Thus we 
often assume thatF is Inrking in the background without specifically mentioning it. 
With the usual operations of addition 
and scalar multiplication, F" is a vector 
Space Over F, as you should verify. The 
example of F" motivated our definition of Vector spDace. 


1.23 example: F デ 


F* is defmed to be the set of all sequences of elements of F: 


77e y77 の /e57 vec7 の 7 SD の Ce 75 {0}, 7 
co の 7274775 O77/ の 76 7777. 


F や ニー 人 (YY … ) ir EEFfor た = ニ 1.2,…). 
Addition and scalar multiplication on F ぐ are defined as expected: 


(5) ) 十 (1, >) … ) 王 (Y」 十 ザイ 2 十 7 うぅ) … 0 
ル (Y」, そ っ, 語り ヒー (Ar, っ , ーー )。 


With these definitions,F becomes a Vector space Over F, as you should verify. 
The additive identity in this vector space is the seduence of all 0's. 


Our next example of a Vector space involves a set of functions. 


1.24 notation: F? 
e If Sis a set, then F? denotes the set of functions from S to F. 
es For ogFSthes7/+gF? is the function defined by 
げ + 8)(%) = が ( 々 ) + 8( ズ ) 
forallxe5. 


e ForA と Fand/ と EE? thep7ogzc7 AF? js the function defined by 


(ML2 有 王将) 


forallxE6. 


14 Chapter 1 VectorSpaces 


As an example of the notation above, 5 is the interval [0, 1] andF = R, then 
RIO.1] is the set of real-valued functions on the interval [0, 1]. 
You should verify all three bullet points in the next example. 


1.25 example: F? 7s vec7O7 SCe 


e If S is a nonempty set。 then F? (with the operations of addition and scalar 
multiplication as defined above) is a vector space OVer F. 


e The additive identity of F? is the funcion0:5 っ Fdefined by 
0(*) = 0 


forallxe5. 
e For/EF? the additive inverse of is the function 7/: 5 っ Fdefined by 


(- の (<) = ー が が *) 
forallrE6. 


The vector space F" is a special case 
of the vector space F? because each 
(Cm) Fcan be thought of as 7y7y. 777 86767 の 7 の VeC7O7 SDC6 ZS 77 
a function * from the set (1.2,…,7) to の y77C7 @7777 の YOye 6/c77767779 7777g77 
by writing x(%) instead ofxkforthe 旭 ん 7 が ss, 77c77O725, の 7 We が 7 の の /ec75. 
coordinate of (r」, .…, ,). In other Words, 
we can think of F7 asE 全 … Similarly, we can think of EY asF 

Soon we will see further examples of vector spaces, but frst we need to develop 
some of the elementary properties of Vector SDaceS. 

The definition of a Vector space reduires it to have an additive identity. The 
next result states that this identity 1S unique. 


77,e e/e7ze775 の 如 e vec7o7 spgce RIO.]1 
g7e 76g7-Vg774ed 放 72c7O745 O77 [0, 1], 77o7 


人 1.2.…) 


1.26 777797e 77Zye 7de77777 が の 


A vector space has a unique additive identity. 


Proof Suppose 0 and 0' are both additive identities for some vector space 
Then 


0 =0+0=0+0'=0, 


where the first equality holds because 0 is an additive identity, the second equality 
comes from commutativity, and the third equality holds because 0' is an additive 
identity. Thus 0' = 0, proving that has only one additive identity. 


Each element o in a Vector space has an additive inverse, an element の in the 
Vector space such that の o+ の =0. The nextresult shows that each element in a 
Vector space has only one additive inverse. 
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Proof Suppose is a vector space. Let vV Suppose の and の are additive 
inverses of o. Then 


の 三 の 二 0 王 の 十 ( の 二 の ) 三 (の 二 の ) 二 の ニニ 0+ の ニニ の ! 


Thus zp = op as desired. 


Because additive inverses are unidue, the following notation now makes sense. 


Let o, の ビリ V Then 


e の denotes the additiVe inverse Of の : 


e の ー の 1S defimned to be の + (一 の ). 


Almost all results in this book involve some vector space. TO avoid having to 
restate frequently that V is a vector space, we now make the necessary declaration 
once and for all. 


In the next result, 0 denotes a scalar (the number 0 E ) on the left side of the 
equation and a Vector (the additive identity of り ) on the right side of the equation. 


Proof Foro と wehave 


77e 7es7477 7 7.30 7 の es ee 2 の 7777Ve 
Op ニニ (0+0)9= ニ 0o+06. 77e77777 の y の g7 の scg7 の 7 772777 の 77Cd77 の 77. 

77,e o7/ の 77 の 娘 e 76777777O72 の 7  UeC- 

Adding the additive inverse of 0o to both 7 の 73/Ce 7 co7 が 6C7S VeC7O7 gd777O7 


sides of the equation above gives 0 = Oo, 7 の ycg7g7 727777 の 77cg77O77 75 7 が e 75- 
as desired. 777 の 77e の 7 の Pe7 が , 7775 77e 7 の 2- 


7ue /7 の /677 777457 の e 74569 777 777e 7 の o/ 


Tn the next result, 0 denotes the addi- 7.30 


tive identity of V Although their proofs 

are similar, 1.30 and 1.31 are not identical. More precisely, 1.30 states that the 
product of the scalar 0 and any vector equals the Vector 0, whereas 1.31 states that 
the product of any scalar and the vector 0 equals the vector 0. 
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1.31 4 777 の e7 7777ey 77e vec7O7 0 


0 三 0 for every g  F. 


Proof Forz と F, we have 


0 ニ g(0+0) 三 Z0+g0. 


Adding the additive inverse of 40 to both sides of the equation above gives 0 = 0, 
as desired. 


Now we show that i an element of is multiplied by the scalar 一 1, then the 
result is the additive inverse of the element of K 


1.32 娘 e 777 の 67 一 1 777776y の VeC7 の 7 


(-1)? = -?for everyo の と 


Proof Foro と wehave 


の + (1)o = 1o+ (1)? = (1+(-1))o = Oo =0. 


This equation says that (一 1)?, when added to ?, gives 0. Thus (1)? is the 
additiVe inverse of ?o, as desired. 


re7c7yey 7 


1 Prove that 一 (--?) =?for everyo と と 
2 Supposeg 三 FE,o と andzo=0.Provethat2= ニ 0oro=0. 


3 Suppose の の ビレ BExplain why there exists a uniguex ツ such that 
の +3 メ ー (の. 


4 The empty set is not a vector space. The empty set fails to satisfy only one 
of the requirements listed in the defimition of a vector space (1.20). Which 
one? 


S Show that in the definition of a vector space (1.20), the additive inVerse 
condition can be replaced with the condition that 


0o=0forallo と 
Here the 0 on the left side is the number 0, and the 0 on the right side is the 
additive identity of 


77e 7ye の "CoO72777O77 Cg77 の e 76//2Ce の "777 7 の @777777O77 776 の 775 7777 770e 
co//ec77o7: 7 o//ec75 yg779725 77e の @/777777 の 7 75 772C7272567 が 77e O77g777G7 
c の 7 の 777O7 75 76P/2ce の y7777 77e 7ew CO7d777O77. 
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Let co and 一 oo denote two distinct objects, neither of which is in R. Define 
an addition and scalar multiplication on R U {oo, 一 oo} as you could guess 
from the notation. Specifically, the sum and product of two real numbers is 
as usual, and forf R define 


ーco 7<0, oo if<0, 
foo ニュ 0 定 チー 0, 一 oo) = 10 下 #=0, 
oo 7> 0, ーoo 計 了 >0, 


and 


{ 二 oo 三 o+ オニ co 十 ooG Go, 
# 十 (一 oo) 三 (一 oo) 十 7 = (一 oo) 二 (一 oo) 三 ーーoo, 
co 寺 (一 oo) 三 (一 oo) 二 oO 三 0. 


With these operations of addition and scalar multiplication, is R U (oo, 一 eo} 
a Vector space over R? Bxplain. 


Suppose S is a nonempty set. Let "? denote the set of functions from 5 to 攻 
Define a natural addition and scalar multiplication on P? and show that P? 
is a Vector space with these definitions. 


Suppose is a real Vector SDace. 


es 。 The co の /ex 太 cg7 が or Of V denoted by た , eduals リ x ソ An element of 
Vc is an ordered pair (の ), where 7, の but we write this as 7 の . 


e Addition on Vc is defined by 
(4 填 7 の 1) 填 (72 填 の 2) 三 (4 填 77) 填 7( の 」 二 の ) 
for al 4 の 72 の っ モ 
e Complex scalar multplication on Vis defned by 
(2 二 7)(7 二 の) ニ (2 一 の ) 二 7(2 の 二 万 ) 
for all47,5 あ ERandallo と ど 


Prove that with the definitions of addition and scalar multiplication as aboVe, 
WC is a complex Vector sDace. 
777 ん gs gs の se7 o/ Vc の 7 の e77 の 7g 7 ビリ wz 7 十 70. 777e co7257774C- 


7o7 の 7 Vc 方 o77 V cg7 万 e7 の e 77Og77 の 7 2y ge72@7777<777g 7 CO775774C77O72 
の C" 方 oz RT 
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7C 5 の spgcey 


By considering subspaces, We can greatly expand our examples of vector SDaceS. 


1.33 definition: yi/ の spgce 


Asubset of Vis called a spypgce of 主 is also a vector space with the 
same additive identity,。 addition, and scalar multiplication as on 


The nextresult giVes the easiest Way oz 2 
to check whether a subset of a vector ez s7 の spgee, w 太 C7 eS 太 e 


SDaCe 1S a SuDsDaCe. 57776 9 SSDGCe. 


1.34 co7777O75 /27 9 S74 の の の C6 


Asubset U of is asubspace of and only if U satisfies the following 
three conditions. 


additive identity 
0 と 


closed under addition 
の Uimpliesg+oU. 


closed under scalar multiplication 
Fandz と implies gz /. 


Proof TUisasubspaceof Pthen け 77e gd777e 7 の e7777 が の CO72777O72 の の の Ve 
satisfies the three conditions abovebythe 7 pe 7ep/ce 7 7 が e cong777on 
definition of Vector SDace. 罰 g7 7 75 7o7ze7 の が (の ecgzzye 7e7z 7 た 

Conversely, suppose satisfies the 訪 zz  U gd pg の y 0 
three conditions above. The first condi- oz/2 娘 p/ の 万 0 万) 万 owever 
tion ensures that the additive identity of が gszpyerUo/V が 72ee の sz の - 
V is in . The second condition ensures spgce, 娘 e7 74S497/y 娘 e 7C ん es7 gy 
that addition makes sense on /.Thethird 7os7ow 娘 d7 けが な 7O7e7 の が な 7 の 37 の 
condition ensures that scalar multiplica- 娘 0EU 
tion makes sense on /. 

Ifz  , then - [which equals (一 1) by 1.32] is also in by the third 
condition above. Hence every element of has an additive inverse in /. 

The other parts of the definition of a Vector space, such as associativity and 
commutativity, are automatically satisfied for because they hold on the larger 
space Thus is a vector space and hence is a subspace of 


The three conditions in the result above usually enable us to determine quickly 
whether a given subset of is a subspace of You should verify all assertions 
in the next example. 
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1.35 example: yj/ の sy の gcey 


(a) Hf ちと, then 
{(], 5, Y3, 4 ) 三 F^ ・ 1 ヒー DX4 十 人 


is a subspace ofF* 下 and only if5 ち =0. 


(b) The set of continuous real-valued functions on the interval [0, 1] is a subspace 
of RIO11 


(c) The set of differentiable real-valued functions on R is a subspace of RE 


(d The set of differentiable real-valued functions on the interval (0,3) such 
that 7/(2) = pis a subspace of R⑦ う 正 and only 放ち = 0. 


(e) The set of all sequences of complex numbers with imit 0is asubspace of で 


Verifying some of the items above 
shows the Hmnear structure underlying 
parts of calculus. For example, (b) above 
requires the result that the sum of two 
continuous functions is continuous. As 
another example, (d) above requires the 
result that for a constant c, the derivative 
ofc げ equals c imes the derivative of た 


77e ye7 {0) 75 77e y74477es7 yy の ce oO/ 
V g7 の V 7 が 5e/ が 7 が 5 77e /27ges7 4 の 5 の の C@ 
の V 77e e7 の が 5@7 75 7707 の 7 の 5 の の C@ 
の V の ecgz4ye の s の 5 の pgce 72457 の e の 
YeC7 の 7 SDC6 7 の 7677Ce 7777497 CO777777 7 
/e7 O776 7e772677, 7797776) 77 7777re 
79e777). 


The subspaces of R< are precisely {0}, all lines in R2 containing the origin, 
and R<2 The subspaces of R? are precisely {0}, all ines in R containing the origin, 
all planes in R* containing the origin, and R* To prove that all these objects are 
indeed subspaces is straightforward-the hard part is to show that they are the 
only subspaces of R2 and R* That task will be easier after we introduce some 


additional tools in the next chapter. 


S7775 の 7 S7 の 5 の DC@y 


When dealing with vector spaces, We are 
usually interested only in subspaces, as 
opposed to arbitrary subsets. The notion 
of the sum of subspaces will be useful. 


1.36 definition: yz777 の 7 y/ の sy の gcey 


77e 7777O77 の 5 の PC@5 75 7 の 7 の 5 の - 
SCe (yee 研 e7c7se 72), 7 5 が 
We 5 Wo7 7 y7775 7 の 77e7 777 
7777 の 775. 


Suppose 尼 ,.…, し , are subspaces of / The sz of の,…、,, denoted by 


久 キー ォ ル ア 。, is the set of all possible sums of elements of 尼 ,.……, し ,. More 
precisely, 


2 GCC SF IM ヒー {?」 ao の ・ の 1 居 MS っ 0 ( 守 MV 
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Let's look at some examples of sums of subspaces. 


1.37 example: 4 s77 の 7 sy の spgces の 7 F? 


Suppose is the set of all elements of F* whose second and third coordinates 
equal 0, and MW is the set of all elements of F* whose first and third coordinates 
edual 0: 


= 人 (xr.0.0) モ ES:xeEE) and W= 人 (0, み 0) EE7 EE). 


Then 
ロ +W = 人 (の 0) EE 7EE], 


as yoOu should verify. 


1.38 example: 4 s77 の 7 sg の spgcey の 7 F* 


SUDDOSe 
ワニ {((⑦ ゆ る め の FEF) and ={x の モ FT 7y ビ E]). 


Using words rather than symbols, we could say that is the set of elements 
of F* whose first two coordinates equal each other and whose third and fourth 
coordinates equal each other. Similarly。 W is the set of elements of F3 whose first 
three coordinates equal each other. 

To find a description of  + WW, consider a typical element (2,, り , 5) of and 
a typical element (c, c,c, の ) of W, where 4, ち ,c,7 FE. We have 


(4, の ,, の) 十 (Cc,C,。C。 の ) ニ (2 十 C7 二 りす りす の ), 


which shows that every element of リ + W has its first two coordinates equal to 
each other. Thus 


1.39 ロ + WC 人 {の 2) EFZF). 
To prove the inclusion in the other direction, suppose *,, 2 F. Then 
(, え , ,Z) 叶 (, ア 。 7) 玉 (0,0, 0,z ーー ), 


where the first vector on the right is in and the second vector on the right is 
in W. Thus (y,r, 2Z) と + WI, showing that the inclusion 1.39 also holds in the 
Opposite direction. Hence 


U+W ={(% あ の め 2) FT : ャ の Z モ E), 


which shows that り + W is the set of elements of ES whose first two coordinates 
edual each other. 


The next result states that the sum of subspaces is a subspace, and is in fact the 
smallest subspace containing all the summands (which means that every subspace 
containing all the summands also contains the sum). 
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1.40 。s7777 の 7 57 の PC@y 75 777e 77777/es7 CO77777777776 7 の 9 の Ce 


Suppose MM .…,, are subspaces of Then +…+ ォ レア, is the smallest 
subspace of containing ,… ッ ,. 


Proof The reader can verify that キー+V ル , contains the additive identity 0 
and is closed under addition and scalar multplication. Thus 1.34 implies that 
キー ォ キリ is a subspace of 

The subspaces ,… 攻 。 are all con- 577709 の y4 の 5 の の Ce@y 77 77e 77eo7y の 7 vec- 
tainedin キー ォ ル 。 (to seethis,consider /, 3 の gcey の 7e の 7OgO7 7O 777O745 の 
Sums の 」 キ … の Where all except One spse/s 娘 se/ eo7y. Oive7z no sZ の - 
of the os are 0). ConVersely, eVery Sub- gces 7 vec7o7 の gce, 7e yg7/es7 
space of V containing 中 ,…, し 。 contains sz の spgce co772 が が 7g 7e77 75 万 e が sg が 7. 
必 キー ォ ル , (because subspaces must 4zg/ogo4s/, gye72 YO 574 の ye/5 の 7 6 ye ん 
contain all finite sums of their elements). 娘 e szg//es7 yy の ye7 Co77777729 77 な 
Thus キー ォ ア is the smallest subspace 娘 e7 77 の 77. 
of containing 尼 ,…,,. 


の 7ec7 57777y 


Suppose ,…,, are subspaces of "Every element of V+…ー+ ォ リア , can be 
written in the form 
の す … 二 の 。 


where each , 尺 . Of special interest are cases in which each vector in 
必 キー ォ ア 。 can be represented in the form above in only one way. This situation 
is so important that it gets a special name (direct sum) and a special symbol (⑤⑧). 


1.41 definition: 7ec7 s7777 の 


Suppose MP ,… の 。 are subspaces of 


e Thesum 尼 キー is called a の 7ec7 yz777 tf each element of キー ィ オル 
can be written in only one way as a sum の 」… 二 の Where each o, 6 . 


ef キー オリ Visa direct sum, then 中 6 も …@ り , denotes 中 オー オア 
with the @ notation serving as an indication that this is a direct sum. 


1.42 example: 2 77ec7 y77777 の 7 カル の yy の gC@y 


Suppose Uis the subspace of F? of those vectors whose last coordinate equals 0, 
and W is the subspace of FE? of those vectors whose first two coordinates equal 0: 


={((Y か 0) EE iryEF) and W= 人 (0,.0,z) EEP: zeF]). 


ThenEF*= ニ リ @ WW,as you should verify, 
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1.43 example: 9 7ec7 57777 の 7477777 の /e 574 の の の C6y 


Suppose is the subspace ofF" of 
those vectors whose coordinates are all 
0, except possibly in the slot: for example, ゆ = {(0,,0,.…,0) と F" : と F). 
Then 


70 /7 の gzzce ⑥ 7 77, の pe Nop1us. 


FE7 ニ 必 の ⑧… の ,, 
as you should verify. 


Sometimes nonexamples add to our understanding as much as examples. 


1.44 example: 9 57772 777 75 7707 の 77@C7 y77777 


SUDDOSe 
{0) 6 Fi ァ 7 せ ), 
ゆめ ={0.0.2) と EzeEE1, 
=((0O. め の と FT ieE]). 
ThenEF* ニ ++ WW because every Vector (*, 2) F3 can be written as 
(*, り ,Z) ニ (Y,,0) + (0, 0,z) + (0,0,0), 


where the frst vector on the right side is in 尼 , the second vector is in の, and the 
third vector is in !. 

However, F? does not equal the direct sum of 必 , の , の , because the Vector 
(0,0, 0) can be written in more than one way as a sum の?」 の 填 の 。, With each 
cr W. Specifically, we have 


(0, 0,0) = (0, 1, 0) + (0, 0,1) + (0, 一 1, 1) 


and, of course, 
(0,0,.0) = (0,0,0) + (0,0,0) + (0,0,0), 


where the first vector on the right side of each equation above is in 尼 , the second 
Vector is in の, and the third vector is in . Thusthesum 必 キナ + WiSnota 
direct sum. 


The definition of direct sum requires ZZ,。 07 @, WC が が の 5 902 
every vector in the sum to haVe a unidue 訪 s7egcyyc/e, 7e7777 の 5 5 太 7 re の 
representation aS an apDrODriate Sum. cg/g 7 spec7G7 ype の s77 の 7 
The nextresult shows that when deciding sjspgces 一 egc7 e/e77e777 7 放 e 77ec7 
whether a sum of subspaces is a direct  s ヵ cgzz pe 7ep7ese77e 7 の 777y O7e Gy 
Sum, We only need to consider whether0 Zsgs7z oe/eze7 が 5 7o7z 7 が e spec77e の 
can be uniquely written as an aDDTODTiate sz の spgces. 

Sum. 
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1.45 co7z777O7 /27 77ec7 574777 


Suppose 中 ,.……, し , are subspaces of Then +ー+ ォ レル, iS a direct sum if 


and only せ the only way to write 0 as a sum の 」 キ …+ る 6 where each or 
is by taking each o, equal to 0. 


Proof First suppose 引 ユー リザ 1S a direct sum. Then the definition of direct 
sum implies that the only way to write 0 as a sum の 」 キー の Where each or 尼 , 
is by taking each ?, equal to 0. 

Now suppose that the only way to write 0 as a sum の 」 キ …+ エ の Where each 
cr ルル, is by taking each o, equal to 0. To show that キー ォ リ リア, is a direct 
sum,let の 三 叶 キー+ ォ レア, . We can write 


の の 」 キ … 二 の 


for some o」 6 の ,…, の ,。 し. To show that this representation is unique, 
SUDDOSe We also have 
の ニキ … 二 の 


where 」 必 ,… っ と Subtracting these two equations, we have 
0=(ー) キ … キ (の の ッ ー). 
Because の 」 一 4 の ーー モモ ,,the equation above implies that each 


の 一 7 eduals 0. Thus の 」 ニル …, の 4 8S desired. 


The next Tesult gives a simple con- ヶ 7,。 二 282 謗 202202808722822 
dition for testing whether a sum of two “が gn の oy が 7 が が s yy7i の oO7 co47 g75o 


Subspaces iS a direct sum. pe 7eg 7 の 776 の 7 “75 6947D の 7e777 7 の 


1.46 の 77ec7 y77777 の 7 の 54 の y の の C@y 


Suppose and W are subspaces of Then 
ロ + Wisadirect sum < UnW=t0). 


Proof Hirst suppose that + Wis a direct sum. fo リロ WW, then 0 = ゥ + (一 の ), 
whereo と and-o MW. By the unique representation of 0 as the sum ofa 
Vector in andavectorin W, wehaveo=0. Thus nMW = (0), completing 
the proof in one direction. 

To prove the other direction, now suppose Un W = (0}. To prove thatU+W 
is a direct sum, suppose 7 三 , co 古 W, and 


0= ニ 7+ の . 


To complete the proof, we only need to showthatz ニ の =0(by 1.45). The 
equation above implies thatz ニー の W.Thusz と UnW. Hencez = 0, which 
by the equation above implies that の = 0, completing the prootf. 


24 


The result above deals only with 
the case of two subspaces. When ask- 
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74725 の 7 yy の CS の 76 7777O6O74 ゞ 7 の 
47277 の 75 の / s4 の ye75. 5777777277 の の, の 77ec7 


ing about a possible direct sum With ys 7 si の ypgcey 7e 77G/Ogo4 の 
more than {WO subspaces。 it iS noOt が yo 77Os の / sy の se/s. Wo vo s の - 
enough to test that each pair of the sgceyo7gyec/or spgce cg の e の oO の 
subspaces intersect only at 0. 1O see pecgzse po77 co7727 が 0. So 大 7 の 7 た 
this。consider Example 1.44. In that 7ess 7 7ep/gceg の 7 /egs7 7 太 e cgye 
nonexample of a direct sum, we have の 7Wo si の spgce$, 7 77e 7e97476776777 
届 ロ = ニ 層 ロリ ロ ニ ロリ =(0). 7747 777e 7777e7yec77O77 69797 {0). 


re7c7yey 7 


10 


For each of the following subsets of FE? determine whether it is a subspace 
of E”. 

(a) {(,*2, Ya) FE : 2Y。 3x。 =0} 

(b) {5,) 征 本 2*。 +3x。 ニ 41 

(6) (ea) 曲 wox。 三 UU 

(0 1 や.20 の ) 和 ニー ニ 55 1 


Verify all assertions about subspaces in Example 1.33. 


Show that the set of differentiable real-valued functions on the interval 
(一 4,4) such that /(-1) = 37(2) is a subspace of RC も 


Suppose p R. Show that the set of continuous real-valued functions on 
the interval [0,1] such that 記 = pis a subspace of RT1] i and only if 
ち =0. 


Is R^ a subspace of the complex vector space C<? 


(4) Is {(2⑰. あ ec) モ ER? :/ グ ニア が ) asubspace of R?9 
(b) Js {(2. か 6 EC だ ニア の) a subspace of で?? 


Prove or give a counterexample: Tf / is a nonempty subset of R2 such that 
U is closed under addition and under taking additive inverses (meaning 
ーz whenever z  ), then is a subspace of R^ 


Give an example of a nonempty subset of R< such that is closed under 
scalar multiplication, but / is not a subspace of R^ 


Afunction た R っ Riscalled pe77ogzc if there exists a positive number 
such that げ (*) = /( 々 + カ ) for allxE R. Is the set of periodic functions 
from R to R a subspace of RF? Bxplain. 


Suppose V and ゆめ are subspaces of Prove that the intersectonn ロ の 
is a subspace of 


11 


12 


13 


14 


15 
16 


17 


18 


19 


20 


21 


22 
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Prove that the intersection of every collection of subspaces of Vis a subspace 
of 


Prove that the union of two subspaces of is a subspace of 証 and only if 
one of the subspaces is contained in the other. 


Prove that the union of three subspaces of is asubspace of and only 
if one of the subspaces contains the other two. 


7775 ere7C75e 75 5 の 7 の 777267y 7 の 7e7 娘 27 Ye7c7ye 72, の sy の ecgzzse 7 な 
eXe7C7Se 7$ 707 76 が we 7e//gce F 777 6 7e/7 co7772777775 O7/ カル の 6/e7776775. 


SUDDOSe 
={((%ー%2x) 古本:zEEH and ツ = ニ {2*) と 本). 


Describe + W using symbols, and also give a description of+ W that 
uses no Symbols. 


Suppose Uis a subspace of Whatis リ + ロ ? 


Is the operation of addition on the subspaces of commutative7 In other 
words, iand W are subspaces OiSs リ + す WW テニ W+OU7? 


Is the operation of addition on the subspaces of V associative7 In other 
words, 区 の, ゆい are subspaces of is 


Does the operation of addition on the subspaces of "have an additive 
identity? Which subspaces have additive inverses? 


Prove or give a counterexample: 攻め ,U are subspaces of Vsuch that 
キサ ニー の の + ォ ルル 
then = ゆ . 
SUDDOSe 
={(( 池 の FT izy と FE). 
Find a subspace W of FE* such thatFH キ ニ ロ @W. 


SUDDOSe 
= 人 (テキ テー の 2Y) EE : EE). 


Hind a subspace W of E* such thatEF5 ニ リロ @ WI 


SUDDOSe 
={((Y の テキ テー の 2Y) EE : EE). 


Find three subspaces Wi, WW, W。 of F? none of which equals {0}, such that 
FE=U@eWieW ゆ WeW. 
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Prove or give a counterexample: 区 , の, are subspaces of such that 
= 色 @U and ソリ ソ = ニ の @ 


then 三 の. 
万 7 Me7 7y72g 7 の の scove7 we7e7 の C の 776C747e 7 77776g7 7ge の 7 の 75 7746 
or 故 /se, 7 が 5 の 7e7 ye/7 7 の 7g77 の y eXP67776727777g 77 < 


Afunction 7: R っ Riscalled evez 下 
(-*) = ア (*) 
forallyER.Afunction た R っ Riscalled od7 
(一 %) ニー ナ (⑦) 


forallyER. LetV denote the set of real-valued even functions on R 
and let 、 denote the set of real-Valued odd functions on R. Show that 
RF ドニ @ 必 . 
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Chapter 2 匠 nd 


In the last chapter we learned about vector spaces. Linear alegebra focuses not 
on arbitrary Vector spaces, but on finite-dimensional Vector spaces, which we 
introduce in this chapter. 

We begin this chapter by considering linear combinations of Hsts of vectors. 
This leads us to the crucial concept of linear independence. The linear dependence 
lemma will become one of our most useful tools. 

A list of vectors in a vector space thatis small enough to be Hinearly independent 
and big enough so the Hnear combinations of the Hst fill up the vector space 1s 
called a basis of the vector space. We will see that every basis of a vector space 
has the same length, which will allow us to define the dimension of a Vector sDace. 

This chapter ends with a formula for the dimension of the sum of two subspaces. 


7472 の 777g の 9977777 の 77O775 7 の 7 7775 72GP76 チ 


e F denotes R or C. 
e denotes a Vector sDace OVer F. 


77e 7 が 777 の 77777g の 7 77e 77257777e 7 の 7 447ceg S7 の y 77 7727ce7O7。 We 7e7se). 
7gz/ 刀 4/77oy (7 の 76-2006) 7o7e 7 が e 7777 77Oe777 77726 の 7 7/ge の 7 oo ん 772 7775 4777777g. 
刀 g/77oy y /77eg7 7ge の 7 の oo ん gy の 77ye7 77 79 ダ 2 (yeco7g eg の 77O7 の 4 の 7 が ye 7 7956). 
77e 777e o/ 刀 Z777 の y S の oo ん gy 77e SG77e gy je 7777e の 7 娘 75 C72 の 76 た 


@⑥ Sheldon Axler 2024 27 
S. Axler, 7zeg7 4/ge の 7g の o7ze Azg77。 Undergraduate Texts in Mathematics, 
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24 Spg77 7 の 76 の 7 777 の 6/6727e77Ce 


We have been writing Hsts of numbers surrounded by parentheses, and we wil 
continue to do so for elements of F7: for example, (2, 7,8)  F* However, now 
we need to consider Hists of vectors (which may be elements of F" or of other 
Vector spaces). To avoid confusion, we will usually write Hists of vectors without 
Surrounding parentheses. For example, (4, 1, 6), (9, 5, Z) is a Hist of length two of 
vectors in R? 


777eg7 CO77 の 777277O729 の 77 の Sg77 


A sum of scalar multiples of the vectors in a Hist is called a Hinear combination of 
the Hist. Here is the formal definition. 


A /7eg7 co7 の 7 の 7 の 7 Of a ist の 」,… の Of Vectors in V is a vector of the form 


の 1 の 1 コ F PC. コロ の の > 


where 4 , …, 9, F. 


2.3 example: 77eg7 co の 7g77o725 77 RY? 


e (17, 一 4.2) is a linear combination of (2, 1, --3), (1, 一 2,4), which is a ist of 
length two of vectors in R3 because 


(7 も 2) 62 1 ルー8) て ニー2.20。 


e (17, 一 4.5) is not a linear combination of (2, 1, 一 3), (1, 一 2, 4), which is a list 
of length two of vectors in R? because there do not exist numbers g」,4。 FE 
Such that 

(17, 一 4,5) = g」(2, 1, 3) + (1, 一 2,4). 


In other words, the system of equations 


17 =24 キ の 


has no solutions (as you should Verify). 
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The set of all linear combinations of a Hst of vectors ?」,…, の, in Vis called 
the spg7 Of の 」 。… の denoted by span( の 」,…, の). In other words, 


SDan( の 1,…, の) 三 (91 の キー の の 。 1 の)… っ 9 の 。 ). 


The span of the empty Hst ( ) is defined to be {0). 


2.5 example: SDan 


The previous example shows that in E? 
e (17, 一 4.2) span((2, 1, 一 3), (1, 一 2, 4) ) : 
e (17, 一 4,5) span((2, 1, 一 3), (1, 一 2,4) ). 


Some mathematicians use the term 777ze7 s の 7 Which means the same as 
SDan. 


2.6 5 の 72 75 77e y7777/es7 CO77727777749 S7/ の y の の C@ 


The span of a Hist of Vectors jm V is the smallest subspace of V containing all 
Vectors in the Hst. 


Proof Suppose の ],…, の 1S a Hst of vectors in / 
First we show that span( の 」,.…, の 。) 1S a Subspace of The additive identity is 

in SDan( の 」,.…, の) because 

0=0gg す …+ エ 0. 
Also, span( の 」, …, の 。) 1S closed under addition because 

(4 の キ … の. の ) 二 (1 の 」 キー オロ) (本 二 ロ ) の 0」 キ … 二 (2 の. 
Furthermore, SDan( の 」, …, の 。) 1S closed under scalar multiplication because 
4 ん (21 の キー の) 三 A21 の 」 キー オル 7 の 


Thus span( の 」,…, の 。) 1S a Subspace of (by 1.34). 

Each oc is a Hinear combination of o」, .…, の (to show this, set 7 1 and let 
the other g's in 2.2 equal 0). Thus span( の 」,…, の 。) contains each o,. Conversely, 
because subspaces are closed under scalar multiplication and addition, every sub- 
space of that contains each or contains span( の ],…, の 』). Thus span( の 」, .…, の ) 
is the smallest subspace of containing all the vectors の 」,…, の. 


Tf span( の ,…, の) eduals we say that the Hst の ,…, の 5 の 7 が 5 / 
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2.8 example: 9 7757 77g7 pg7 が 5 F7 


Suppose 77 1S a Dositive integer. We want to show that 
(1,0, .…, 0), (0, 1, 0, …, 0), .… (0,..……,0, 1) 


spans F* Here the びび vector in the list above has 1 in the 記 slot and 0 in all other 
slots. 
Suppose (Y」,…,,) FT Then 


(て ) 三 (1.0,.…,0) + * っ (0, 1, 0,…,0) + …+ ィ ,(0,.……, 0, 1). 
Thus (Y」,…, *。) span((1, 0,.…,0),(0, 1, 0, .…, 0), .…, (0,.…, 0, 1) ), as desired. 


Now we can make one of the key definitions in linear algebra. 


2.9 definition: 訪 777e- の 7777e7757O727 VeC7 の 7 $ の の C6 


A vector space is called 太 777e- の 772e72y7O7g7 if some Hst of Vectors in it spans 
the space. 


Pxample 2.8 above shows thatF"isa ecg// 7 の y の 6777777O7 eVe7y 7757 72y 
finite-dimensional Vector space for every 訪 e /ezg7 


POsitive integer 7. 
The defimition of a polynomial is no doubt already familiar to you. 


2.10 definition: po/72o77797, ア (E) 


e Afunctionp:F っ Fiscalled a po/n7zo77777 with coeficients in F ifthere 
exist 2n, …, 5 ビ F such that 


= 2 77 
(Z) 三 0 十 912Z 十 の 52 二 … 二 の る 


forallzEF. 


es の (F) is the set of all polynomials with coefcients in F. 


With the usual operations of addition and scalar multiplication, ア (F) is a 
vector space over F, as you should verify. Hence ア (F) is a subspace of F『 the 
Vector space of functions from F to . 

Tf a polynomial (thought of as a function from F to ) is represented by two 
sets of coefcients, then subtracting one representation of the polynomial from 
the other produces a polynomial that is identically zero as a function on F and 
hence has all zero coefcients Gf you are unfamiliar with this fact, just believe 
it for now: we will prove it later 一 see 4.8). Conclusion: the coefcients of a 
polynomial are uniquely determined by the polynomial. Thus the next definiton 
uniquely defines the degree of a polynomial. 


Section 2A Span and Linear Independence 31 


es A polynomial p ア (EF) is said to have eg7ee 77 IT there exist scalars 
0 … っ 9。 FE withg, 0 such that for every z F, we have 


(2 上 王 IEEEDOEHI702 
es The polynomial that is identically 0 is said to have desree 一 co. 
es The degree of a polynomial ヵ is denoted by deg 了 pp. 


In the next defnition, we use the convention that 一 oo < 7 which means that 
the polynomial 0 is in の,(F). 


For 7 a nonnegative integer, の ,(F) denotes the set of all polynomials with 


coefcients in F and degree at most 77. 


Tf 太 isanonnegative inteser, then の , (FE) = span(1,z, …,Z7") [here we slightly 
abuse notation by letting z* denote a function]. Thus アア, (F) is a finite-dimensional 
Vector space for each nonnegative integer 77. 


A vector space is called 7 訪 77e- の 772e7497 の 744/ i 1t 1S not finite-dimensional. 


2.14 example: の (F) 7s 万 万 7e- の 77776757O7g7. 


Consider any Hst of elements of ア (F). Let 7 denote the highest degree of the 
polynomials in this Hst. Then every polynomial in the span of this Hist has degree 
at most 7 Thus z7+1 is not in the span of our list. Hence no list spans ア (F). 
Thus アア (F) is infinite-dimensional. 


7777eg7 777e/e77e7Ce 
Suppose の , …, の 。 ビレ ando span(o」,…, の). By the definition of span, there 
exist 2 ,…, 所 F such that 

の の] キー の の 
Consider the question of whether the choice of scalars in the equation above is 
unique. SUDDOSe C, …,C』。 1S another set of scalars such that 


の 三 C1 の 1 vw 本 の ・ 
Subtracting the last two equations, we have 


0 ヒー (] 5 C] ) の 1 EE (4 還 当 の 
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Thus we have written 0 as a Hinear combination of (の 」,…, の). the only way 
to do this is by using 0 for all the scalars in the Hinear combination, then each 
gz 一 Cr eduals 0, which means that each , equals c, (and thus the choice of 
scalars was indeed unique). This situation is so important that we give it a special 
name 一 Hinear independence--which we now defime. 


2.15 gefinition: 777eg77 7 の 6 の pe777e777 


e Alist の 。 Of vectors in Vis called 77eg7 の 7 の epe7 の e77 i せ the only 
choice of 2」, .…, 9 三 F that makes 


の キー オキ の の 0 
1S2 地 三 ec 三 !7 表 三 10 


e The empty Hist ( ) is also declared to be Hinearly independent. 


The reasoning above shows that の 」, …, の 1S Hmearly independentif and onlyf 
each vector in span( の 」, …, の 。) has only one representation as a hinear combination 
Of の 」」… の 


2.16 example: 7777eg7 の か 7 の epe77 の 777 /7975 


(a) 1o see that the Hist (1,0,0,0),(0, 1, 0,0), (0, 0, 1.0) is Hinearly independent in 
F* suppose 2」, の 9。  F and 


(1.0.0.0) + g。(0.1.0.0) + (0,0,1.0) = (0.0.0.0). 


Thus 

(g」,,93,0) ーー (0,0,0,0). 
Hence2」= ニ = ニ g。 =0. Thus the Hst (1,0,0, 0), (0, 1, 0,0), (0,0, 1,0) is 
linearly independent in E+ 


(b 


ヽ ュ ン 


Suppose 77 1S a nonnegative inteser. To see that the Hst 1,z, …, 7 is hnearly 
independent in ア (EF), suppose 20, 1, …, 5 ビ F and 


20 9 の 2Z キ … 二 2 ー0, 
where we think of both sides as elements of の). Then 
0 寺本 2 キキ … 二 gg27 ニ 0 


for all z EF. As discussed earlier (and as follows from 4.8), this implies 
thatgg ニニ の ニー テニ 0. Thus 1, 2 …,Z77 1S a Hinearly independent list in 
ア (F). 


(c) A Hst of length one in a vector space is hnearly independent if and only ifthe 
Vector in the list is not 0. 


(d 


ュ ン 


A list of length two in a Vector space is Hinearly independent i and only 下 
neither of the two vectors in the list is a scalar multiple of the other. 
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Tf some vectors are removed from a linearly independent Hist, the remaining 
Hst is also linearly independent, as you should verify. 


2.17 definition: / 太 zeg77y ee77 の 777 


es Aljist of vectors in Vis called /77eg7 か の の epe7e777 if it 1S not hnearly inde- 
pendent. 


e jn other words, a Hst の 」,.…, の 。 Of vectors in is Hinearly dependent if there 
exist 2 ,…, 9 所 F。 not all 0, such that 2 の 7] キー 二 4 の 三 0. 


2.18 example: 7777eg77 ee77 の e777 /7575 


e (2.3,1),(1, 一 1.2),(7, 3,8) is linearly dependent in F? because 
2(2, 3, 1) 中 3(1 ー1, 2) 叶 (--1)(7, 3, 8) 二 (0, 0, 0). 
e The list (2.3,1),(1, 1.2), (7, 3,c) is linearly dependent in F? 計 and only 
c = 8, as you should verify. 
e If some vector in a list of Vectors in is a linear combination of the other 
Vectors, then the Hist is linearly dependent. (Proof: After writing one Vector in 


the Hist as equal to a Hinear combination of the other Vectors, move that Vector 
to the other side of the equation, where it will be multiplied by 一 1.) 


e Every list of Vectors in containing the 0 vector is hnearly dependent. (This is 
a special case of the previous bullet point.) 


The next lemma is a terrific tool. It states that given a Hinearly dependent list 
of vectors, one of the vectors is in the span of the previous ones. Furthermore, We 
can throw out that vector without changing the span of the original ist. 


2.19  /77e7 の ee72e77ce /e777777 の 


SuppOoSe の ],…, の 1S a Hnearly dependent list in じ Then there exists 
た {1, 2, .……,77) such that 


と 所 SDan(C], …, の ー 1)・ 


Furthermore, if た satisfies the condition above and the 中 term is removed 
from の 」, ……, の 。, then the span of the remaining Hst equals span( の 」, …, の). 


Proof Because the Hist o」,.…,o。 1S hnearly dependent, there exist numbers 
の っ の 生 F, not all 0, such that 


1 の 」 キ … キ の の 0. 
Let た be the 1argest element of {1, .…,77) such that . チ 0. Then 


which proves that , SDan( の ], …, の 1), aS desired. 
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Now suppose た is any element of {1, .…,77} such that span( の ], ……, のみ _ 1)- 
Let ,… み 1F be such that 


2.20 (4 三 り 」o」 士 … 十 の 1 の 
Suppose 7 三 SDan( の 」,…, の). Then there exist c], …, Fsuch that 
7 三 C1 の 1 キキ see ギ 7 の ・ 


Im the equation above, we can replace o, with the right side of 2.20, which shows 
that z is in the span of the list obtained by removing the term from o」,… の. 
Thus removing the term of the list o」,… の 。 does not change the span of the 


Hist. 


た =1inthe Hinear dependence lemma, then o, SDan( の 」, …, の 。_- ュ ) means 
that o」 = 0, because span( ) = {0}. Note also that parts of the proof of the Hinear 
dependence lemma need to be modified if た = 1. In general, the proofs in the 
rest of the book will not call attention to special cases that must be considered 
involving Hists of length 0, the subspace {0)}, or other trivial cases for which the 
result is true but needs a slightly different proof. Be sure to check these special 
cases yOurself. 


2.21 example: s772G//es7 た 7 /777e7 de の 674 の e7Ce /6777777 の 


Consider the ]ist 
(1,2, 3) , (6, 5, 4), (15, 16, 17), (8.9,Z) 


in R* This list of length four is linearly dependent, as we will soon see. Thus the 
jinear dependence lemma implies that there exists た {1,2,3, 4} such that the Ab 
vector in this Hist is a linear combination of the previous vectors in the list. Let's 
see how to find the smallest value of た that works. 

Taking た = 1inthe Hinear dependence lemma works if and only if the frst 
Vector in the Hist equals 0. Because (1,2,3) is not the 0 Vector, We cannot take 
ん = 1 for this Hist. 

Taking = 21in the linear dependence lemma works if and only ithe second 
Vector in the list is a scalar multiple of the first vector. However, there does not 
exist c  R such that (6, 5, 4) = c(1, 2, 3). Thus we cannot taker = 2 for this list. 

Taking た = 3in the Hinear dependence lemma works if and only the third 
Vector in the list is a linear combination of the first two vectors. Thus for the list 
in this example, we want to know whether there exist ヵ , ヵ R such that 


(15, 16, 17) = 2(1, 2,3) + 5(6,5,4). 


The equation above is equivalent to a system of three linear equations in the two 
unknowns g, ち . Using Gaussian elimination or appropriate software, we find that 
g 三 3, り =2isa solution of the equation above, as you can Verify. Thus for the 
Hist in this example, taking た =3isthe smallest value of た that works in the hnear 
dependence lemma. 
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Now we come to a key result. It says that no Hinearly independent list in Vis 
longer than a spanning listin 


2.22 /e7zg77 の 7 太 7eg77 7 の e/e74 の 6777 /757 < /e77g77 の 7 5 の 72727726 7757 


In a fimite-dimensional vector space, the length of every linearly independent 


Hist of Vectors is less than or equal to the length of every spanning Hst of 
Vectors. 


Proof Suppose that 4 ,…, 入 1S Hinearly independent in じ Suppose also that 
の …。 の 。 SDans / We need to prove that 7 く 7. We do so through the process 
described below with 77 steps: note that in each step we add one of the /s and 
remove one Of the の 'S. 


Step 1 
Let p be the Hist の 」, …, の, which spans じ Adjoining z」 at the beginning of 
this list produces a Hinearly dependent list (because z」 can be written as a hnear 
combination of の 」,.…, の). In other words, the jist 


4] の 1],…。 の 


is hinearly dependent. 


Thus by the linear dependence lemma (2.19), one of the vectors in the Hst above 
is a linear combination of the previous vectors in the list. We know that ヵ 0 
because the Hst 7 …, 4 1S Hinearly independent. Thus z」 is not in the span 
of the previous vectors in the Hist above (because z」 is not in {0}, which is the 
span of the empty Hs も). Hence the Hnear dependence lemma implies that we 
can remove one Of the の "s so that the new list P (of length 7) consisting of 
and the remaining の 's spans 


Step ん た, for = 2, .……, 77 
The list (of length ヵ ) from step 一 1 spans V Im particular, 1S in the span of 
the list . Thus the list of lensth (7+ 1) obtained by adjoining to , placing 
itjust after 2, .…, 7 ー ュ 1S hnearly dependent. By the linear dependence lemma 
(2.19), one of the vectors in this Hist is in the span of the previous ones, and 
because 7 .…, 7 1S hinearly independent, this Vector cannot be one of the Ss. 


Hence there still must be at least one remaining の at this step. We can remove 
from our new list (after adjoining 7 in the proper place) a の that is a jinear 
combination of the previous vectors in the list, so that the new Hist (of length 
7) consisting of 。…, gr and the remaining の 's spans 


After step 77, We have added all the /s and the process stops. At each step 
as we add a zz to p, the Hinear dependence lemma implies that there is some yp to 
remove. Thus there are at least as many の 'S as 7 S. 
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The next two examples show how the result above can be used to show, without 
any computations, that certain lists are not linearly independent and that certain 
Hists do not spDan a giVen Vector SDace. 


2.23 example: 7o 7 が 57 の 7 /eg 太 4 5 eg7 が の 7 の epe7e77 7 民 ? 


The Hist (1,0,0),(0,1,0), (0.0,1), which has length three, spans R? Thus no 
list of length larger than three is linearly independent in R* 

For example, we now know that (1, 2,3), (4,5,8), (9, 6,7), (3, 2,8), which 
is a list of length four, is not linearly independent in R ふ 


2.24 example: 7o /7s7 の 7 /ezg77 3 py R* 


The Hist (1, 0, 0,0), (0, 1, 0,0), (0, 0, 1, 0), (0, 0, 0, 1), which has length four is 
linearly independent in R* Thus no list of length less than four spans R* 

For example, we now know that (1,2,3, 5)., (4, 5, 8, 3), (9, 6, 7, 一 1), which 
is a list of length three, does not span R^4 


Our intuition suggests that every subspace of a finite-dimensional vector space 
should also be finite-dimensional. We now prove that this intuition is correct. 


2.25 777e- の 777767297O79/ s7/ の 5 の DC@y 


Every subspace of a fimite-dimensional vector space is finite-dimensional. 


Proof Suppose is finite-dimensional andUisasubspace of Weneed to 
prove that / is finite-dimensional. We do this through the following multistep 
constructiOn. 


Step 1 
Hf = (0), then is finite-dimensional and we are done. IT チ {0}, then 
choose a nonzero vector 7 


SteD ん 
TU = span( 妨 ,…, 1), then U is fimite-dimensional and we are done. 
/ 子 span(,…, 太 - ュ ), then choose a Vector 7z Usuch that 


7 生 SDan(7],…, 7 た ー 1) ・ 


After each step, as long as the process continues, we have constructed a jist 
of Vectors such that no Vector in this Hst is in the span of the previous Vectors. 
Thus after each step we have constructed a linearly independent list, by the Hinear 
dependence lemma (2.19). This inearly independent Hist cannot be longer than 
any spanning list of り (by 2.22). Thus the process eventually terminates, which 
means that / is finite-dimensional. 
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万 Ye7c7yey 24 


1 Find alist of four distinct vectors in F? whose span equals 
{(*, 2) と FT : ィ + リ + タ 0]. 
2 Prove or give a counterexample: 1f の 」, の っ , の 3, の 4 SDans P then the list 
の 」 一 の, の > 一 の 3, の s 一 4, の 4 

also spans 

3 Suppose の 」,… の 18 a Hist of Vectors in For {1,.…,77), let 
の 三 の 」 キ … 二 の 
Show that spDan( の ],…, の) 三 SDan( の ],…, の ). 


4 (a) Show that a Hst of length one in a vector space is Hinearly independent 
i and only 主 the Vector in the Hist is not 0. 
(b) Show that a Hist of length two in a vector space is Hinearly independent 
i and only ineither of the two vectors in the Hst is a scalar multiple of 
the other. 


S Hind anumber 7 such that 
(3, 1, 4), (2, ー3, 5), (5, 9, 1 
is not linearly independent in R* 


6 Show that the list (2,3, 1), (1, 一 1,2), (7,3,c) is hnearly dependent in F3 if 
andonly fc=8. 


7 (a) Show that we think of C as a vector space over R, then the jst 
1+1 一 7is Hinearly independent. 
(b) Show that if we think of C as a vector space over C, then the Hist 
1+1 一 7is linearly dependent. 


S Suppose の 」, の っ , の 3, の 4 1S hnearly independent in / Prove that the Hist 
(2 人 の っ , の っ ed の 3, の 3 “= 寺 の 4, の 4 
is also hnearly independent. 


9 Prove or give a counterexample: Hf の 」, の っ ,…, の 。 1S a Hinearly independent 
Hist of vectors in then 


っ の 1 一 4 の っ , の っ , の 3。…) の 


is hinearly independent. 
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Prove or give a counterexample: If の 」, の っ ,…, の 。 1S a Hinearly independent 
jst of vectors in and え ん と Fwith 邦 0, then Ao」, 和 の .…, Ao 15 Hinearly 
independent. 


Prove or give a counterexample: To」,… の 。and の,… の are Hnearly 
independent lists of vectors in then the list の 」 十 の ],…。 の 。 十 の 1S hnearly 
independent. 


Suppose の 」,…, の 。 1S linearly independentin じ andw と ツ じ Prove that 
の 」 填 の 。…, の 填 の 1S Hinearly dependent, then の span( の 」,…, の 。). 


Suppose の ],…, の 1S Hinearly independent in and eV Show that 
の っ の の 1S Hinearly independent < っ の spDan( の 」,…, の 。)・ 
Suppose の ],…, の 1S a Hst of Vectors jn For た 人 1, .……,77)。 let 


(2 一 (| キュ て た 


Show that the Hst の 」,…, の, 1S hnearly independent if and only if the Hist 
の …, の 1S Hinearly independent. 


Explain why there does not exist a Hist of six polynomials that is inearly 
independent in の,(F). 


Explain why no list of four polynomials spans の ,( ド ). 


Prove that is infinite-dimensional if and only 証 there is a seduence の 」, の っ , ・… 
of vectors in V such that o」, …, の 1S Hinearly independent for every positive 
integeT 77. 


Prove that F ぐ is infinite-dimensional. 


Prove that the real vector space of all continuous real-valued functions on 
the interval [0, 1] is infinite-dimensional. 


Suppose po, っ Te DOlynomials in の ,() such that (2) = 0for each 
た {0,.…,77). Prove that の, …, 15 not Hinearly independent in の グ ,(F). 
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2/ /gyey 


In the previous section, we discussed linearly independent lists and we also 
discussed spanning lists. Now we bring these concepts together by considering 
Hists that have both properties. 


2.26 definition: の gs7y 


A pgszy of Vis a Hst of Vectors nthat is linearly independent and spans 


2.27 example: の 2yey 


(a) The list (1,0, .…,0),(0, 1, 0, .…, 0),.……,(0, .……,0, 1) is a basis of F? called the 
5727g77 py7y of FT 
The Hist (1,2), (3,5) is a basis of F^ Note that this list has length two, which 


is the same as the length of the standard basis of F^ In the next section, We 
will see that this is not a coincidence. 


(b 


ヽ ュ ン 


(c) The Hist (1,2, --4), (7, 5,6) is linearly independent in F? but is not a basis 
of FE" because it does not span F* 


(d 


ュ ン 


The Hist (1,2),(3,5),(4, 13) spans F< but is not a basis of FE because it is not 
jinearly independent. 


(e) The list (1,1.0), (0,0, 1) is a basis of {(x,Y,7) Fi 7). 
(⑪) The Hist (1, -1, 0), (1, 0, 一 1) is a basis of 


{(Y。 2) ET : ィ + リ +Z= テ 0). 
(g) The Hist 1,z,…,27" is a basis of の ,(E), called the s72zg477 の gs7y Of の,( ド ). 


In addition to the standard basis,F" has many other bases. For example, 
(7Z,5), (一 4,9) and (1,2), (3,5) 


are both bases of F^ 
The next result helps explain why bases are useful. Recall that “uniquely 
means “in only one way 


し た 】 


2.28 c777e77O72 / の 7 の 75 


A list o」,.… の, Of vectors in Vis abasis of キソ and only if everyo と Vcan 
be written uniquely in the form 


2829 のり 三 の 1 の ] 二 … 十 本 の 


where 4], …, 9, 古 F. 
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Proof JirSt suppose that の 」。… の 。 15 8 77775 7 の の 7 75 eyse77777y 7 7e の 67777O77 の 7 


basis of Let の 誠 V Because の 1。… っ の 。 訪 e 2ggy 故 g7 7ed y 7o 7e の e 罰 7777O7 の / 
Spans there exist 2 …。 記 所 F such eg: 72egpe7ge7rce。 


that 2.29 holds. To show that the repre- 
sentation in 2.29 is unidue, SuDDose C] , …,C,, Te SCalars such that we also have 


の 三 C1 の 1 二 ** 寺 の 
Subtracting the last equation from 2.29, we get 
0 = (2 一) の 」 キ … 二 (5 一) の 


This implies that each , 一 cr eduals 0 (because o」, …, 6, 1 Hinearly independent). 
Hence 2」 ニ C」,…。 三 We have the desired uniqueness, completing the proof 
in one direction. 

For the other direction, suppose every o Vcan be written uniquely in the 
form given by 2.29. This imples that the Hst の 」, …, の , Spans To show that 


の っ の 1S Hinearly independent, suDDose ], …, 叶 , 所 F are such that 


0 = の キ … 二 の の 


The uniqueness of the representation 2.29 (taking ? = 0) now implies that 
ーー の ニ 0. Thus の 」,… の 1S Hinearly independent and hence is a basis 
of 


A spanning Hist in a Vector space may not be a basis because it is not linearly 
independent. Our next result says that given any spanning list, some (possibly 
none) of the vectors in it can be discarded so that the remaining list is linearly 
independent and still spans the vector sDace. 

As an example in the vector space F^ if the procedure in the proof below is 
applied to the Hst (1,2), (3,6),(4, 7), (5,9), then the second and fourth Vectors 
will be removed. This leaves (1,2), (4,7), which is a basis of F< 


2.30 eve7y y/G7777779 7757 CO777777 の の 575 


Every spanning Hist in a vector space can be reduced to a basis of the Vector 
SDaCe. 


Proof Suppose の 」, …, の, SDans We want to remove some of the vectors from 
の っ の, SO that the remaining vectors form a basis of We do this through the 
multistep process described below. 

Start with equal to the Hist の 」,…, の,. 


Step 1 
Tf ?」 = 0, then delete ?」 from p. If ?」 了 チ 0, then leave p unchaneed. 


SteD ん 
Tf 1S in span( の ,…, み - ュ ), then delete ov from the Hst p. To,is notin 
SDan( の 」, …, Cr_ ュ ), then leave P unchanged. 
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Stop the process after step 7, getting a list p. This hst p spans "because 
our original Hist spanned and we have discarded only vectors that were already 
in the span of the previous vectors. The process ensures that no Vectorin ぢ is 
in the span of the previous ones. Thus ぢ is linearly independent, by the Hinear 
dependence lemma (2.19). Hence p is a basis of 


We now come to an important corollary of the previous result. 


2.31 の 4y7s の 7 万 777e- の 777767297O77 の 7 ec7O7 ゞ DC6 


Every finite-dimensional Vector space has a basis. 


Proof By definition, a fimite-dimensional vector space has a spanning Hist. The 
previous result tells us that each spanning list can be reduced to a basis. 


Our nextresult is in some sense a dual of 2.30, which said that every spanning 
Hist can be reduced to a basis. Now we show that given any linearly independent lst, 
we can adjoin some additional vectors (this includes the possibility of adjoining 
no additional vectors) so that the extended list is still linearly independent but 
also spans the space. 


2.32 eve7y 万 zeg77 7 の e/e746777 7757 eX7e725 7O 9 57y 


Every linearly independent list of Vectors in a finite-dimensional Vector space 
can be extended to a basis of the vector space. 


Proof Suppose 4 …, 4 1S Hmearly independent in a fimite-dimensional Vector 
space V Let の 」,.…, の, be a Hist of Vectors that spans Thus the list 


っ の の] っ の 


spans じ Applying the procedure of the proof of 2.30 to reduce this Hist to a 
basis of produces a basis consisting of the vectors 7 ,…, nd some of the 
の 's (none of the 7/s get deleted in this procedure because 4」,.…, 4 1S Hinearly 
independent). 


As an example in F?> suppose we start with the linearly independent list 
(2,3, 4), (9, 6,8). T we take の 」, の 。, の 。 to be the standard basis of F3 then applying 
the procedure in the proof above produces the Hist 


(2, 3,4), (9, 6, 8), (0, 山 0), 


which is a basis of F* 

As an application of the result aboVe, 22 2 
we now show that every subspace ofa zzceg 7Oo/5, 7 が e 7eX7 765777 cg77 の e 
finite-dimensional Vector SDace can be oyeg 7 が or7 7 が e の po が esfs 放 の 7 が 
paired with another subspace to forma 記 e-g の es7o7g7 
direct sum of the whole space. 
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Proof Because V is finite-dimensional, so is 7 (see 2.23). Thus there is a basis 
2 っ … っ 4, Of (by 2.31). Of course ,…) 1S a Hnearly independent list of 
Vectors in Hence this list can be extended to a basis 7 」…, 2 の 1 …) の 。 Of 
(by 2.32). Let W = span( の ,.…, の 。). 

To provethat ソ = リ e WMW, by 1.46 we only need to show that 


= リロ +W and ロミ (0). 
To prove the first equation above, supposeo モリ V Then, because the jst 
2 の 1 …) の 。 SDans there exist 9, のり] っ 古 F such that 
の 三 の 2 キー 寺 の 4。 土 婦 の キー…ー キ ちの. 
ーーーーーーーーーーーーーー ーーーーーーーー ーーーーーーーー 
7 の 


Wehaveo ニ ルル + の ⑦,wherez と andwE W are defined as above. Thus 
の けり + WW completngthe proofthat ソ ニー ロリ ロ + MW. 

To show that Un W = (0), supposeo と nMW. Then there exist scalars 
の っ の っ の] っ 三 F such that 


の キー の 44。 三 の キー キ ち の 


Thus 
の 2 キー の 7 ぁ ーD の ーー ちの =0. 


Because 2] 7 の …) の 。 1S Hinearly independent, this implies that 


1 3 の り 」 ie り , 0. 


Thus? = 0, completng the proofthat ロ W=(0}. 


re7c7yey 2 ア 


1 Find all vector spaces that have exactly one basis. 
2 Verify all assertions in Bxample 2.27. 
3 (a) Let be the subspace of R? defined by 
は (AAM、20) 上 千 NP 1 ニー905 am ニー706 し 


Find a basis of . 
(b) Extend the basis in (a) to a basis of R ゝ 
(c) Find a subspace WofRY*suchthatR2=UeW 


10 


11 
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(a) Let be the subspace of C? defined by 
(2 の 2262 る 0) 所 C" 1 62 ニー る and +2%。 キ 82 01. 


Find a basis of . 
(b) Extend the basis in (a) to a basis of C? 
(c) Find a subspace Wof CsuchthatC=Ue WW 


Suppose is fimite-dimensional and /, W are subspaces of V such that 
= リ + MW. Prove that there exists a basis of consisting of Vectors in 
UMW. 


Prove or give a counterexample: fn, , の, Ps 1S a Hst in グ の 4(F) such that 
none of the polynomials ,, の の, has degree 2, then po,, の っ の 1S not 
a basis of の 。(E). 


SuDDOse の , の っ , の 3, の 4 1S a basis of Prove that 
(2 平 の っ の っ 平 の っ の 3 平 4。 の 4 
is alsoabasis of 


Prove or give a counterexample: If ?」, の っ , の 。, の 4 1s a basts oOf ソ and Uisa 
subspace of V such that o」, の 。 Uando。 びり and?4。 U,then の 」,> 1S a 
basis of /. 


Suppose の ],…, の 1S a Hst of Vectors jn For た 代 ,.……,77)。 let 
(2 三 の 1 圭 … 十 (2 
Show that の 」,…, の 1S a basis of 下 and only 下 の,… の 1S a basis of 


Suppose and W are subspaces of suchthat ソ = ロリ @ WMW. Suppose also 
that 7 …, 15 a basis of and の 」, …, の , 1S a basis of IW. Prove that 


っ の 1 > 7 の 
is a basis of 


Suppose V is a real vector space. Show that if ?」,…, の , 1S a basis of (asa 
real vector space), then の 」, …, の , 1S also a basis of the complexification て 
(as a complex vector Space). 


See 万 Ye7c7Se ぐ 77 5ec7O77 7 / め 7 7e de7777777O7 の 7 77e co7 の /er77cg77O77 Vc. 
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2C の 777e7257O77 


Although we have been discussing finite-dimensional vector spaces, we have not 
yet defined the dimension of such an object. How should dimension be defined? 
A reasonable definition should force the dimension ofE" to equal 77. Notice that 
the standard basis 


(1,0, .…, 0),(0,1, 0, …,0), .… (0,..……,0, 1) 


ofF" has length 7. Thus we are tempted to define the dimension as the length of 
a basis. However a fimite-dimensional vector space in general has many different 
bases, and our attempted definition makes sense only if all bases in a given vector 
space have the same length. Fortunately that turns out to be the case, as We now 
Show. 


Proof Suppose is finite-dimensional. Let p」 and ぢ 。 be two bases of Then 
gp」 is Hinearly independent in and ぢ 。 spans so the length of p」 is at most the 
length of 。 (by 2.22). Interchanging the roles of p」 and 。, we also see that the 
length of p。 is at most the length of p」. Thus the length of p」 equals the length 
Of っ , as desired. 


Now that we know that any two bases of a fimite-dimensional vector space 
have the same length, we can formally define the dimension of such spaces. 


「 2.35 gdefinition: の 77e77 の 7 dim 


e The 72e7257 の 72 Of a fimite-dimensional Vector space is the length of any 
basis of the vector space. 


e The dimension of a finite-dimensional vector space V is denoted by dim 


2.36 example: 7777e7757O7 ゞ 


e dimE" = ニ ァ because the standard basis of F" has length 7. 


e dim グ (FE) ニカ 1 because the standard basis 1,z, .…,Z" of の,(E) has length 
77 十 1. 

ef リ ニ 人 {の EE”: 7 所), then dim 7 = 2because (1,1,0),(0,0,1) is 
a basis of /. 


es If = {か 2) と F3: ァ 二 り +zー 0)}, then dimU = 2because the list 
(1, 一 1,0),(1,0, 一 1) is a basis of /. 
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Every subspace of a fimite-dimensional vector space is fimite-dimensional 
(by 2.2S) and so has a dimension. The next result gives the expected inequality 
about the dimension of a subspace. 


2.37 7777e727O77 の 7 @ 74 の 5 の の C6 


T is fimite-dimensional and / is a subspace of V then dim / < dim 


Proof Suppose is fnite-dimensional and isasubspace of Think of a basis 
of as a Hmnearly independent ist in Vand think of a basis of V as a spanning 
list in 尼 Now use 2.22 to conclude that dim 7 < dim 


To check that a Hst of vectors in 
isa basis of We must。 according to S7O77 Or 777e Co777 の /er ec7O7 の gce C 
the definition, show that the Hist in ques- /。 ezszo7 oze。 4s 22 CA 
tion satisfies two properties: itmustbe  /。 7e777ed 7 が C (gr gg が 7o7 な 
jinearly independent and it must SDan レ 。 訪 e sge oz 27 が spges, gs 75 scg77 
The next two results show that 党 thelHisSt 訪 訪 cg77o7 py 7eg7 77 の ers). 7775 
in question has the right length,then we ryjez we 7g 克 の oz7 太 e の 7e77O77 の が 
only need to check that it satisfies one vecor spgce, 如 e 7o/e p/Zye の の 77e 
of the two required properties. Firstwe cozceo/ F cg7zo7 の e 7eg/ec7e. 
prove that every Hinearly independent Hist 
of the right length is a basis. 


2.38 /7eg77y 7 の epe7 の 6777 /757 の 7 如 e 77g777 /e77g777 75 6 の 2y75 


Suppose V is fimite-dimensional. Then every linearly independent list of 
Vectors jn V of length dim V is a basis of 


77,e 7eg/ vec7o7 sgce R< 5 7777677- 


Proof Suppose dim ソ = 7and の,… の , 1S Hinearly independent in The Hst 
の っ の, Can be extended to a basis of (by 2.32). However, every basis of has 
length 7, so in this case the extension is the trivial one, meaning that no elements 
are adjoined to o」,…, の Thus の 」,…、 の, 1S a basis of P as desired. 


The next result is a useful consequence of the previous result. 


2.39 sz の spgce の 7 7/7 777767257 の 7 675 777e y77O/e 5 の Ce 


Suppose that V is fmite-dimensional and is a subspace of V such that 
dim / = dinV Then テア 


Proof Let ,…, 叶 be a basis of . Thus 7 = dim /, and by hypothesis we 
also have ヵ = dim WV Thus 7 …, 記 , 15 a Hinearly independent list of vectors in レ 
(because itis a basis of け ) of length dim From 2.38, we see that 4 ,…, 74, 1S 
abasis of In particular every vector in Vis a hnear combination of 7 ,… 
Thus ソリ テ ザ ソ 
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2.40 example: ggs7s 7 F< 


Consider the list (5,7),(4,3) of vectors inF< This list of length two is linearly 
independent in F< (because neither vector is a scalar multiple of the other). Note 
that F2 has dimension two. Thus 2.38 implies that the linearly independent list 
(5,7),(4, 3) of length two is a basis ofE< (we do not need to bother checking that 
it spans F^). 


2.41 example: の の gyy の の yg の 5 の ge の げ 5(R) 


Let / be the subspace of の 。(R) defined by 
リ = 人 E(R) : が 5) = 0}. 


To find a basis of , first note that each of the polynomials 1, ( ャ ー5)3 and (*ー5)? 
is in 7. 
Suppose 4 ち ,c 三 R and 


gg テー5)2+c(xー5)3 =0 


for every xy R. Without explicitly expanding the left side of the equation above, 
we can see that the left side has a cy” term. Because the right side has no *" 
term, this implies that c = 0. Because c = 0, we see that the left side has a /x^ 
term, which implies that ち = 0. Because り = ニ c=0, we can also conclude that 
g = 0. Thus the equation above impliesthatg ニ ちち =c=0. Hence the Hst 
1,(ー5)2(ー5)? is linearly independent in /. Thus 3 < dim 7. Hence 


3< dimU< dim の 。(R) = 4, 


where we have used 2.37. 

The polynomial * is not in because its derivative is the constant function 1. 
Thus U チ の 。(R). Hence dim チ 4 (by 2.39). The inequality above now implies 
that dim 7 = 3. Thus the linearly independent list 1.( ャ ー5)2 (ーー5)? in has 
length dim / and hence is a basis of U (by 2.38). 


Now we prove that a spanning Hist of the right length is a basis. 


2.42 の 7777777g 7757 の 7 77e 77g777 /e77g777 75 6 の 575 


Suppose V is finite-dimensional. Then every spanning Hst of vectors in of 
length dim V is a basis of 


Proof Suppose dim ソ = 7 and の ,…, の 6, Spans The Hst の 」,…, の 。 Can be 
reduced to a basis of (by 2.30). However, every basis of has lensth 7, so in 
this case the reduction is the trivial one, meaning that no elements are deleted 
from の 」, …, の. Thus の 」, .……, の, 1S a basis of as desired. 
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The next result gives a formula for the dimension of the sum of two subspaces 
of a finite-dimensional vector space. This formula is analogous to a familiar 
counting formula: the number of elements in the union of two finite sets equals 
the number of elements in the frst set, plus the number of elements in the second 
set, minus the number of elements in the intersection of the two sets. 


2.43  Z7777e7457O77 の 7 @ 574777 


TV and are subspaces of a fimite-dimensional vector space, then 


Proof Let の 」,…) の be a basis of ロウ の: thus dim( n の) = 嫌 . Because 

の っ の Sa basis of ロ の ,itis hnearly independentin 尼 . Hence this Hist can 

be extended to a basis の …。 の 7) … っ 7 Of (by 2.32). Thus dim 必 ニモ カオ 

Also extend の ,.…,6。 【tO a basiS の ]」… の の 1 …。 の r Of の : thus dim の ニカ 二 た 
We will show that 


2.44 っ の >…> 7 の 1。…> (Ok 
is a basis of + の . This will complete the proof, because then we will have 
dm( 攻 + の ) = 
三 ( 娘 用 二 ( 娘 一 如 

The Hist 2.44 is contained in V」 りり > and thus is contained in V」+ り っ . The 
Span of this list contains 」 and contains P。 and hence is equal to V」 + P。. Thus 
to show that 2.44 is a basis of  + ゆめ we only need to show that it is hnearly 
independent. 

To prove that 2.44 is jinearly independent, suppose 

4 の キー 圭二 婦 キオ … 二 ち 太 寺 ロ の キキ … 二 の 三 0, 

where all the 2's, の s, and cs are scalars. We need to prove that all the Zs, の s, 


and c's equal 0. The equation above can be rewritten as 


2.45 の 二 … 十 の ニー の ロー ツー5 の 一 切 要 ー…ー 婦 乱 


which shows that cr の 」 キ …+cr の と 芝 . Althe の 's are in の, so this implies 
that c」 の 」 す … 二 cr の 必 ロ の . Because の 」,…, の, 1S a basis of Vn の, we have 


1 の 」 キ … 二 CO 三 の の ロキ … オ の の 


for some scalars 7 … の But の … の の], Or 1S Hinearly independent, so 
the last equation implies that all the cs (and が s) equal 0. Thus 2.45 becomes the 
eduation 

の 二 … の の 土 妨 寺 … 十 1777 = 0. 
Because the liSt の 1,…, の 7)…> 編 15 Hmearly independent. this eduation implies 
that all the 〆s and の s are 0, completing the prootf. 
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For 5 a fimite set, let #S denote the number of elements of 5. The table below 
compares jinite sets with finite-dimensional vector spaces, showing the analogy 
between #S (for sets) and dim り (for vector spaces), as well as the analogy between 
unions of subsets (in the context of sets) and sums of subspaces (in the context of 


Vector SDaCeS). 


Sets 


Vector SDaceS 


S is a fimite set 


V js a fimite-dimensional vector space 


#5 


dim 


for subsets 5」,5。 of 5, the union 5」 り 5> 
is the smallest subset of S containing 5 
and 5。 


for subspaces 中, 5 ofthe sum + オ の 
is the smallest subspace of 『 containing 
MM amd の 


#(9」 U 82) 
ー #9」 十 #5。 一 #(9」 5。) 


dm(+ 必 ) 
=dim 必 +dmーdm( 必 n め ) 


#(9」 U 5。) = ニ #9」 +#5。 
に ーー 5 n5> ヒコ ゴ の 


dim( 久 + の) = dm 久 Tdim の 
飼 届 リ =(0) 


5」 り …U り US, is a disjoint union を 
#(56」U り …U5。) ニ あ 5」 す … 二 5 


久 エ ーー ェ Visadirectsum e 連 
dim( 急 キー ナオ ) 
=dim 攻 キー の m レ アグ 


The last row above focuses on the analogy between disjoint unions (for sets) 
and direct sums (for vector spaces). The proof of the result in the last box above 


will be given in 3.94. 


You should be able to find results about sets that correspond, Via analogy, to 
the results about vector spaces in Exercises 12 through 18. 


re7czyey 2 


1 Show that the subspaces of R< are precisely {0}, all lines in R2 containing 


the origin, and R^ 


2 Show that the subspaces of R? are precisely {0}, all lines in R? containing 
the origin, all planes in R? containing the origin, and R* 


3 (8) 


Let = 侯 と 之 (F) : が (6) = 0}. Find a basis of . 


(b) Extend the basis in (a) to a basis of 審 (E). 
(c) Hind a subspace W of のみ (F) such that の (F) =U@ WW 


4 (⑧ 


Let リ = 侯 と 少 (R) : が (6) = 0). Find a basis of . 


(b) Extend the basis in (a) to a basis of の ,(R). 
(c) Hind a subspace W of み (R) such that 錠 (R)=Ue WI 


5 (4) 


Let リ = 侯 と み (FE) : ヵ (2) =p5)}. Find a basis of U. 


(b) Extend the basis in (a) to a basis of 審 ,(E). 
(c) Find a subspace W of の (F) such that (E) = ニ U@ WW 


10 


11 


12 


13 


14 


15 


16 


17 
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(&) Let= 信 モ 少 (F) : (2) = ヵ (5) = ヵ (6)}. Hind a basis of /. 
(b) Extend the basis in (a) to a basis of ア ,(E). 
(c) Hind a subspace W of の (ば ) such that (F) =U@ WW 


(&) LetU = 人 少 (R) : 層 ニ 01. Find a basis of U. 
(b) Extend the basis in (a) to a basis of の ,(R). 
(c) Hind a subspace W of み (R) such that 錠 (R) = ニ Ue WI 


Suppose の 」,…, の 1S Hinearly independent in and と Prove that 
dim span( の 」 の ,…。 の 寺 の ) そ ガー1. 


SuppOose 77 1S a Dositive integer and P, の ビア (F) are such that each 
太 has desree . Prove that 7o, カ っ 1S a basis of の ,(F). 


SuDDOSe 77 1S a DOsitiVe integer. For 0 < たく 7 let 
969 応 一 Mi も うり 


Show that ,… 太 。 1S a basis of の ,(F). 
77e の 575 7 7775 ere7C7ye 7eg の 5 7 の 707 97e Cg77eg 6772576772 の 077077277/5. 
7 の cd72 の We の seg7C77 7 の /eg772 7Ow 77476772 の の 72O77775 の 76 76 7 の 
@//7OX772976 CO の 7777774O74S 7477C7 の 75 の 7 [0, 1]. 


Suppose and W are both four_dimensional subspaces of C? Prove that 
there exist two vectors in ソロ W such that neither of these Vectors is a scalar 
multiple of the other. 


Suppose that 7 and W are subspaces of R" such that dimU =3,dimW =5, 
and ロ +W=R' ProvethatR5= ニ U@ WI 


Suppose and W are both five-dimensional subspaces of R? Prove that 
UnW チ (0). 


Suppose V is a ten-dimensional vector space and , の , V。 are subspaces 
of withdim 久 =dm の =din=Z.Provethat 必 ロロ ら nn の チ (0). 


Suppose V is fimite-dimensional and 愉 , の , U。 are subspaces of V with 
dm 久 +dm め の +Tdim >2dm ソ Provethat 必 ロロ n ロ まま (0). 


Suppose V is finite-dimensional and is asubspace of レ with リ チ じ Let 
7 = dim ソ and 娘 = dimU. Prove that there exist 7 一 77 subspaces of 
each of dimension 7 一 1, whose intersection equals . 


Suppose that ,…,, are fimite-dimensional subspaces of Prove that 
キー オア, is fimite-dimensional and 


dm( 力 キー+ ォ ルル) Sdim 軌 キー…+ dm 


77e 77e の 9777y の の ove 7 7 694777 が の 7 の og7 の 7 が 攻 キー オル, 5 の の 7ec7 
s7777。 の S 7777 の e sow77 7 3.9 プ . 
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18 Suppose is finite-dimensional, with dim ニ ァ ッ 1. Prove that there exist 
one-dimensional subspaces MP,.…, , of V such that 


= e…@ 攻 . 


19 BEBxplain why you might guess, motivated by analogy with the formula for 
the number of elements in the union of three fnite sets, that if の, are 
subspaces of a finite-dimensional vector space, then 

dm( 凶 ++M) 
=dm+dm の の +Tdimn の 
ーdim( 攻 ロロ)-dm(M n%) -dim( ら nn) 
+dim 攻 nn ゆめ ). 


Then either prove the formula above or give a counterexample. 


20 Provethat if , の , and are subspaces of a finmite-dimensional vector 
Space, then 


dm(++) 


dm ロウ の )+dim( n%)+ dim(n ロ ゆめ ) 
3 
dm((+ ゆ )n ロ )+ ォ dim(( 層 +)n ゆ ) + dim((+)n 以 ) 
3 5 


77e 7277777772 7 の oe 7 の S6677 5777766 の ecg775e 777e 77g777 77e の oey 7 の 7 /Oo ん 
/7e 7 77776g6 た 


Iat once gave up my former occupations, set down natural history and all its 
progeny as a deformed and abortive creation, and entertained the greatest disdain 
for a would-be science which could never even step within the threshold of real 
knowledge. In this mood T betook myself to the mathematics and the branches of 
study appertaining to that science as being built upon secure foundations, and so 
worthy of my consideration. 


一 77g77e7757e77。 Mary Wollstonecraft Shelley 


Chapter 3 | 


77767 ル 7 の /? 


So far our attention has focused on vector spaces. No one gets excited about 
Vector spaces. The interesting part of linear algebra is the subject to which we 
now turn 一 Hinear maDs. 

We will frequently use the powerful fundamental theorem of Hnear maps, 
which states that the dimension ofthe domain ofa hnear map equals the dimension 
of the subspace that gets sent to 0 plus the dimension of the range. This will imply 
the striking result that a hnear map from a finite-dimensional vector space to itself 
is one-to-one i and only if its range is the whole space. 

A major concept that we will introduce in this chapter is the matrix associated 
with a Hinear map and with a basis of the domain space and a basis of the target 
space. This correspondence between linear maps and matrices provides much 
insight into key aspects of linear aleebra. 

This chapter concludes by introducing product, quotient, and dual spaces. 

In this chapter we will need additional vector spaces, which we call and Wy 
in addition to / Thus our standing assumptions are now as follows. 


e F denotes R or C. 
e ロ ,, and W denote vector spaces OVer F. 


VS OO 9jJ@UOS UEJ9IS 


77e 7ye7777-ce777/7y の 7 ん yg7 の e7ogde Cgs77e 77 7772yW7C (77775C7ye7g), We7e Cg77 

777egd77c7 Oog74sy (7777ー7655) gy po772 2 の g7e 7 の. 7 7609 gss P の 7sed 4 777e77o の 

7 ん 7 yo/776 SYS767745 7 77767 69747 の 775. 77779 77e777o の 77ow cg/7e 474s5772 67777777977 の 7 
Wy 4569 777 6 C7777eye の oo ん W7777e77 の Ve7 7600 yeg7y eg777e た 
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34 Vec7o7 Spgce の 7 777eg7 ル 72/y 


の e7777777o77 977 の 万 27 の /ey の 7 777eg7 7 の y 


Now we are ready for one of the key definitions in hnear algebra. 


3.1 definition: 7777e7 7 の 


A 7/7eg7 7 の from ソ to Wisafunction 了 アテ リー MW with the following 
PTODerties. 


additivity 
了 (7 の ) ニア + 了 oforall ヵ の と 


homogeneity 
了 (Ao) = A(7o) forall え EEandallo と 


Note that for Hinear maps We often So772e 7777777677777C77725 46 777e //77 の ye 
use the notation 7o as well as (heusual ez go7727 が 7, Yo 77eg775 
function notation 了 ( の ). 罰 e se 5 7 が eg7 7 の 

3.2 notation: 々 (WV), ん () 


es The set of linear maps from to W is denoted by 々 (V W). 


e The set of jinear maps from to is denoted by 々 ( じ ). In other words, 
2 の 0% 5 


Let's look at some examples of Hinear maps. Make sure you verify that each 
of the functions defined in the next example is indeed a jinear map: 


3.3 example: /77eg7 7 の Py 


ZeTO 

In addition to its other uses, we let the symbol 0 denote the Hinear map that takes 
every element of some Vector space to the additive identity of another (or possibly 
the same) vector space. 1o be specific.0 と 々 (WW) is defined by 


0? =0. 


The 0 on the left side of the equation above is a function from to W, whereas 
the 0 on the right side is the additive identity in W. As usual, the context should 
allow you to distinguish between the many uses of the symbol 0. 


identity operator 
The 77e77 が の oO/e7g7 の 7, denoted by 7, is the Hinear map on some Vector space that 
takes each element to itself. To be specific, 7 々 () is defined by 


ニーバ. 
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differentiation 
Define D り と 々 (アア (R)) by 

「p// 選 王者 7 
The assertion that this function is a linear map is another way of stating a basic 
result about fferentiation: (7+Tg)) ニ デア +g and( え 用 "= ニル が whenever 記 e are 
differentiable and ル is a constant. 


integration 
Define 7 と 々 ( ア (R),R) by 
1 
サナ カニ [ 8 
The assertion that this function is Hinear is another way of stating a basic result 
about integration: the integral of the sum of two functions equals the sum of the 


integrals, and the integral of a constant times a function equals the constant times 
the integral of the function. 


multiplication by >^ 
Define a linear map 了 と (Z(R)) by 


(7⑰ ゆ )(Y) = YP(Y) 
for each *  R. 


backward shift 
Recall that FT denotes the vector space of all sequences of elements of F. Defne 
ainear map 了 ー ン (FE) by 


了 (r」, パ っ ぅ っ ーー ) 一 (っ 2, 3, ーー ia 
from RY? to R< 
Defne a linear map 7 と 々 (R3R2^) by 
了 (Y,,Z) 三 (2xー リ + 3z,7 ァ + 5y 一 62). 
fromF" to F" 
To generalize the previous example, let 77 and 7 be positive integers, let 4,.EF 


for each7 = 1,.…, 7 and each た = 1, …,7, and define a linear map 了 ヒズ (F7F の ) 
by 


了 (Y」, の に (41 ュ ィ "wed 4 > ーー っ の 22 し と そ )・ 
Actually every hnear map from FE” to F" is of this form. 


composition 
Fix a polynomial 7 と ア (R). Define a linear map 了 と 々 (の (R)) by 


(7p)(y) = (9(Y) ) . 


The existence part of the next result means that we can find a Hinear map that 
takes on whatever values we wish on the vectors in a basis. The uniqdueness part 
of the next result means that a linear map is completely determined by its values 
On a basis. 
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3.4 77eg7 7 の /6777777 の 


SuppOSe の 」, ……, 6, 1S a basis of V and の 」,.…, の ,。 征 W. Then there exists a 
unique Hinear map7: ソー Wsuch that 


ナ ? 三 の 


for each = 1, .……,7. 


Proof First we show the existence of a hnear map 了 ア with the desired property. 
Defne ア テリ ソー っ Wby 


了 (C」 の 」 キー の) 三 1 の 」 キー 二 の , 


where c」, …,, aTe arbitrary elements of FE. The list o」,…, の , 1S a basis of V Thus 
the equation above does indeed define a function from to W (because each 
element of can be uniquely written in the form co」 キオ … エ の ). 

For each た , taking c, = 1 and the other c's equal to 0 in the equation above 
shows that 7 = の 

Hf の と with7 ニ 4 の キオ … 二 号 の and の ニ cd の キー エロ の then 


7T(7+ る の) ニア ((24 em) の キー… 二 ( の 7 寺 ) の ,) 
三 (9 二 C]) の 」 キ … 二 (9 寺 避 ) の , 
三 (9 の 4 の 0」 キ … 十 の 人 の) 十 (C1 の 」 キー オロ の ,) 
ニー イル + 了 の. 
Similarlyif ん Fando= ニ cr の キー の then 
了 (4o) ニ 了 (Ac の 6] キ … 二 Ac の ) 
三 Ac の 二 … 十 Ar の 」 
三 ル (c1 の 」 キ … 0) 
三 人 7 の . 


Thus 了 is a hnear map from to WW 

To prove uniqueness, now suppose that 了 と ズ (W) and that 7 ?, = or for 
each = 1,…,7. Let c」,…,c,  F. Then the homogeneity of 了 implies that 
7 了 (cr の) = ck の rk for each た = 1,…,7. The additivity of 了 now implies that 


了 (C」 の 」 キ … 二 の ) 三 CO の 」 キー オロ の の 


Thus 了 is uniquely determined on span( の 」, …, の,) by the equation above. Because 
の …。 の 1S a basis of this implies that 7 is umiquely determined on as 
desired. 
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AA/ge/7g7c Ope7g77o77 の 7 之 (VMW) 
We begin by defining addition and scalar multplication on 々 (WW). 


3.5 definition: 2777o77 72 の ycg727 7777777 の 77cg77o7 7 之 ( W) 


Suppose 5,7 と 々 (WW) and えと FE. The sz 5 李 and the p7ogzzc7 人 7 are 
the linear maps from to W defmed by 


(5 + ず )(?) = ニ 5 の + 了 To and (47)( の ) = 4(7 の ) 


for allo と 


You should verify that S5+ 了 and A 好 
as defined above are indeed linear maDS. 7eg が Cs. 万 opever 如 ey g7e 7 の 7 の 5 
Im other words, ら と (W) and の 7 の 477O749 5 7278776 の y pe の op/e 7 の 
AE,then 5+ 了 と Z(W) andA ア 7 see 放 罰 た cos 7s 4 7 如 eg7 7 が の か o77 
々 (\ W). R 7o R we77 77ey 72c の 77eC77y 777e 7777 
Because we took the trouble to de- cos(x+y) e9/S COS COS 7 の 747 7 が 7 
fine addition and scalar multiplication on cos2xegzg/s 2 cos * 
(V W), the next result should not be a 
SUTDT1Se. 


7776g7 7 の の 76 67 の 57Pe 777 の 77O77 


3.6 々 (WV W) 7 2 vec7O7 の gce 


With the operations of addition and scalar multiplication as defined above, 
々 (WV MW ) is a vector space. 


The routine proof of the result above is left to the reader. Note that the additive 
identity of 々 (V W) is the zero Hnear map defined in Example 3.3. 

Usually it makes no sense to multiply together two elements of a Vector SDace, 
but for some pairs of hnear maps a useful product exists, as in the next definition. 


3.7 definition: 7 の gz/C7 o/ 7776g7 7 の y 


ff7ー〆( ル げ ) and 5 ん (V W), then the p7ogc7 57 6 々 (U, W) is defined 


by 


(57)(4⑭) ニ 5(77) 
forallzE/. 


Thus 57 is just the usual composition So of two functions, but when both 
functions are Hinear, we usually write S ず 7instead of So 李 The product notation 
S7 helps make the distributive properties (see next result) seem natural. 

Note that 57 is defined only when 了 maps into the domain of 5. You should 
Verify that 57 is indeed a Hinear map from / to W whenever 7 と 々 (,) and 
S と 々 (WW). 
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3.8  g/ge/77C /7O/67776y O7 7 の 97/C75 O7 777767 7 の 


aSsociativity 
(7 の )73 = 本 (7275) whenever 本 , 75, and 7 are Hnear maps such that 
the products make sense (meaning 7。 maps into the domain of 72, and 75 
maps into the domain of 本 ). 


identity 
77 ニ 7 ニア whenever7 ん (V W): here the frst 7is the identity operator 
on and the second 7 is the identity operator on W. 


distributive properties 
(5」+ 52)7 = 5S7+527 amd 5( 世 + 人 の) = 67 + 575 whenever 
7 7 と 々 (, じ ) and 5, 5」,5。 EZ W). 


The routine proof of the result above is left to the reader. 
Multiplication of Hinear maps is not commutative. In other words, it is not 
neceSsarily true that 57 ニ 了 5, even if both sides of the equation make sense. 


3.9 example: nyo 77O72CO7727777477728 7772767 77 の の 77 の (R ) 7o の (R) 


Suppose り と 々 (アア (R)) is the differentiation map defned in Example 3.3 
and 了 と ( ア (R)) is the multiplication by *” map defined earlier in this section. 
Then 


(7D) ヵ ) (y) = xp(x) but ((D7)p) (<) = xp(y) + 2xp(Y). 
Thus 7D チ アーdifferentiating and then multiplying by *" is not the same as 


multiplying by > and then differentiating. 


3.10 /7eg7 7 の 5 7ge 0 7o 0 


Suppose 7 is a linear map from to W. Then 7(0) = 0. 


Proof By additivity, we have 
了 (0) = ニア (0+ 0) = 了 (0) + 了 (0). 


Add the additive inverse of ア (0) to each side of the equation above to conclude 
that 了 (0) = 0. 


Suppose 7 R. Thefuncttion た RーRdefned by 
げ () = 5 


is a linear map if and only ぜ ちり =0(use 3.10). Thus the hnear functions of high 
school alsebra are not the same as Hnear maps in the context of linear algebra. 
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re7c7yey うん 


1 Suppose ヵ ceR.Define7: RY っ R2by 


57 


了 (*,,Z) (2 ァ ー 4 3Z 十 ち 6 CVZ). 
Show that 了 is hnearifand only ちり ニ = ニ c=0. 
Suppose ち ceR.Define7: の (R) っ RS by 


2 
7 = (3P③⑬ + 5p(6) + 砂 (1)p(2), YYp(y) 9 csin PO) ). 
Show that 了 is Hinearifand only 導 り = ニ c=0. 


Suppose that 了 々 (FATF"). Show that there exist scalars 4. FTfor 
= 1,…。 7 and た = 1,.…,7 such that 


(ps) ヒー (41 ュ ィ ヤキ * 4 ーッ 4 1 キッ キ 衝 そ ,) 


777。7 
for every (*」,…,。) FE" 
777y ee7c75e oy 万 7 77e 777eg7 7 の 了 5 77e 727777 7 の 7777569 77 77e 


SecO7 7 の /257 77e77 の 7 777 の /e 3.3. 


Suppose 7 と (WW) and の ,…, の, 1S a Hst of vectors in V such that 
7 の 」,… 7 の 18 a hnearly independent Hst in W. Prove that の,.……, の 。1S 
jinearly independent. 


Prove that 々 (V W) is a vector space, as Was asserted in 3.6. 


Prove that multplication of linear maps has the associative, identity, and 
distributive properties asserted in 3.8. 


Show that every linear map from a one-dimensional vector space to itself is 
multiplication by some scalar. More precisely, prove that if dim ソ =1and 
了 と 々 ( ゆ ), then there exists AF such that 7o = Aofor allo と 


Give an example of a function の : RS っ R such that 
の (4 の) 三 2 の (の ) 


forallz と Randallo と R<but の is not linear. 
777y ere7C7ye 7 777e 7eX7 eXe7CZye 7Ow 7727 7e7777e7 7 の 777Oge72677 ツ 7 の ア 
gd777777y 727e 5 の 7 の 67 7 の 7 の 娘 d7 7727C77O7 7S の 77776g7 7779/. 
Give an example of a function ゅ :C っ Csuchthat 
の (の 2) 三 の (の ) 十 の (2) 
for al の ,zCbut の is not Hinear. (Here C is thought of as a complex vector 
SDaCe.) 


77e7e g/5O er/S7y g 7727C7O7 の : R 一 R szc7 777 の sg77577es 77e 9777y77y 
co7 の 777 の 77 の の ove の 77 の 75 7 の 7 777eg7 万 oweve7 SOw77g 訪 e er757674Ce の / sj 
@ 77C77 の 7 77DO/Vey CO7457 の 7 の 7 の 7e6 47727C6g9 7 の 075. 
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10 Prove or give a counterexample: If 7 と ア (R) and 了 ア : の ア (R) つ の (R) is 
defined by 7 ウニ 95 ヵ then 7is a Hmear map. 


77e 7c77O77 了 de7777e 7e7e の 7 ガ 7y 廊 o77 77e 77c7O7 了 67 の 77 娘 e /257 
/z/77e7 po777 の 7 3.3 の 77e o7e7 の 7 77e 477c77O74 ゞ 77 万 e CO77 の の 777O729. 


11 Suppose Vis fnite-dimensional and 了 7 と 々 (). Prove that 7 is a scalar 
multiple of the identity and only if 57 = 75 for every 5 々 (). 


12 Suppose Uisasubspace ofwith ロ テリ Suppose 5 と 々 (U, W) and 
5 0 (which means that 5z チ 0for somez と 0 り ).Defne7i ソ っ ーWby 


7 5o 下 の と 
あー 
0 iio と Vand ?. 


Prove that 7 is not a linear map on 


13 Suppose V is finite-dimensional. Prove that every Hinear map on a subspace 
of ソ can be extended to a hnear map on Im other words, show thatff Uis 
asubspace of VandS と 々 (, W), then there exists 7 と 々 (V W) such that 
7 =SzforallzeU. 


77e 7ey77 7 7775 ere7C7Se 5 456 の 77 770e /7oo/ の 7 う .725. 


14 Suppose V is finite-dimensional with dimY > 0,and suppose W is infimite- 
dimensional. Prove that 々 (V W) is infinite-dimensional. 


1S Suppose の 」,…。 の 。 1S a hnearly dependent Hst of vectors in Suppose 
also that W {0}. Prove that there exist の 」,.…, の 所 W such that no 
了 7 と (WW) satisfies 7?, = oo, for each = 1,.…,77. 


16 Suppose is finite-dimensional with dimV > 1. Prove that there exist 
5,7 と () such that 57 了 チア S. 


17 Suppose is fimite-dimensional. Show that the only two-sided ideals of 
々 () are {0}) and 々 ( ぴ ). 


4 sz の ypgce ど の て () 7 cg//ed 4 yo-s77e 77eg/7 7 の () が 了 TE と g7 の 
EE7 と の 767g7 と のど g7 の 7 ん (の). 
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3 Az// Sp2cey 77 の 77gey 


zz// Spgce 77 の 7777ec7 が 7 が 


In this section we will learn about two subspaces that are intimately connected 
with each Hinear map. We begin with the set of vectors that get mapped to 0. 


3.11 definition: 77 spgce, null 了 


For7 と バ (W), the zz77 ypgce of 了 , denoted by null 了 , is the subset of レ 


consisting of those vectors that ア maps to 0: 


null7 ニ (の と ソリ :7 ゥ = テ 0). 


3.12 example: 77/ ygce 


e If7isthe zero map from to W, meaning that7o=0foreveryo と ゆ then 
nul ア ニア 


e Suppose の モ と 々 (つて ) is defined by (<,22,22) ニ Z ィ 2 + 32。. Then 
null g equals {<],2 っ ,2。) で : Z」 22。 + 3z。 = 0}, which is a subspace of 
the domain of の . We will soon see that the null space of each linear mapis a 
subspace of its domain. 


e Suppose D り と (の (R)) is the dif- 


77e wo77 "7747 ” 72ed725 Z67 の . 77775 77e 


ferentiation map defned by D ヵ = 
The only functions whose derivative 
equals the zero function are the con- 
stant functions. hus the null space of 


7e7777 "72477 5 の の Ce "7 の 7 7e772772 の OZ 
の 7e co772ec77O77 7 の 0. So7e 77777e- 
777777C772 ゞ 7456 777e 767777 776/ 775769 の 
の 7477 sce. 


equals the set of constant functions. 


e Suppose that 7 と ( ア (R)) is the multiplication by x“ map defined by 
(7 の )() = 2 カ (Y). The only polynomial p such that の (Y) = ニ 0OforallyER 
is the 0 polynomial. Thus null7 = (0). 


Suppose 7 々 (FEP) is the backward shift defined by 


了 (Y], っ , っ, ーー ) 一 (っ , 3 ーー ). 


Then 7(Y」, 5, Y3, … ) eduals 0 半 and only 闘 the numbers *。, Ys,… are all 0. 


Thus null7 = 人 (0.0,.……) : 2). 


The next result shows that the null space of each Hinear map is a subspace of 
the domain. In particular, 0 is in the null space of every Hinear map. 
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Proof Because 了 is a linear map, 7(0) = 0 (by 3.10). Thus 0 null 7 
Suppose 4,? 三 null7. Then 


了 (7 の) ニ T ル + 了 の ワニ 0+0=0. 


Hence 7 + の null7. Thus null 7 is closed under addition. 
Suppose z nul ア and と F. Then 


7 了 (Az) = 47z ニル 0=0. 


Hence Az null 7 Thus null 7 is closed under scalar multiplication. 
We have shown that null 7 contains 0 and is closed under addition and scalar 
multiplication. Thus null ア is a subspace of (by 1.34). 


As we will soon see, for a linear map the next definition is closely connected 
to the null space. 


3.14 definition: 777/ec7ZLe 


A functon ア 7: リー Wis called 7ec が re 下 7 = 7 implies 7 ニ の . 


We could rephrase the definition 
above to say that 7 is injectiveif ヵ 子 o 
implies that7 ヵ チ 7o. Thus 了 is injective 
and only 下 it maps distinct inputs to distinct outputs. 

The next result says that we can check whether a linear map is injective 
by checking whether 0 is the only vector that gets mapped to 0. As a simple 
application of this result, we see that of the linear maps whose null spaces We 
computed in 3.12, only multiplication by *^ is injective (except that the zero map 
is injective in the special case "= {0)). 


777e 767777 の 72@-/ の - の 726 777672? 7776 97776 
@y 77776C776. 


Proof Hirst suppose 了 is injective. We want to prove that null7 = (0). We 
already know that {0}) C null ア (by 3.10). To prove the inclusion in the other 
direction, suppose null ア Then 


了 (?) = ニ 0 =T 了 (0). 


Because 了 is injective, the equation above implies that o = 0. Thus we can 
conclude that null7 = {0)}, as desired. 

To prove the implication in the other direction, now suppose null7 = {0). We 
want to prove that 了 is injective. To do this, suppose ヵ 。 の Vand7z = 7 イ o. Then 


0= ニ 7ー 7 の ニア (2 一 の ). 


Thus 一 の is in null 了 7, which equals {0). Henceー?= 0, which implies that 
=o. Hence 7 is injective, as desired. 
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Ag77ge 7 57777ec7 が 7 


Now we give aname to the set of outputs of a linear map. 


3.16 definition: 747zge 


For 了 と 々 (V W), the 747zge of is the subset of W consisting of those Vectors 
that are equal to 7o for someo ツ : 


ranee7= テ (7o:o と ザ ). 


3.17 example: 7279e 


e If7 了 isthe zero map from to WW, meaning that7o=0foreveryo と ゆ then 
ranee7 テ (0). 


e Suppose 7 と の (R2R?) is defined by 7(x,) = (2x,5,*+). Then 
range7 ニ {(2r,57。* 二 7) : 7 R). 


Note that range 7 is a subspace of R?. We will soon see that the range of each 
element of 々 (V W) is a subspace of W. 


Suppose り と 々 (アア (R) ) is the differentiation map defined by り ヵ = が Because 
for every polynomial 7 ア (R) there exists a polynomial ヵ と ア (R) such that 
の = ゥ の (heranse of り is の (R). 


The next result shows that the range of each linear map is a subspace of the 
vector space into which it is being mapped. 


Proof Suppose 7 と 々 (W). Then 7(0) = 0 (by 3.10), which implies that 
0 range 
Tf 7 の, の 。 range 了 , then there exist の 」, の 。 Vsuch that 7o」 = の 」 and 
7?。 = の >. Thus 
了 ( の 」 の っ) ニナ の 」 二 了 の > ニ の ] 十 の っ . 


Hence の の > range 7, Thus range7 is closed under addition. 
Iforange7and ん,then there existso リ ツリ such that 7o = oo. Thus 
了 (Ao) = AT の Azp. 


Hence Az range 了 . Thus range 了 is closed under scalar multiplication. 
We have shown that range ア contains 0 and is closed under addition and scalar 
multiplication. Thus range 7 is a subspace of W (by 1.34). 
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3.19 definition: s,77ec7 が ive 


A function ア ダミ リー Wiscalled sz77ec7e if its range equals W. 


To illustrate the definition above, note that of the ranges we computed in 3.17, 
only the differentiation map is surjective (except that the zero map iS surjective in 
the special case W = {0). 

Whether a Hinear map 1S surjective de- 
pends on what we are thinking of as the 
vector space into which it maps. 


3.20 example: 77ec7ZV7 の de の @77 の ? 77 777e 77g67 $ の DC@ 


The differentiation map り と 々 (7(R) ) defined by り p ニア 1S not surjectiVe, 
because the polynomial ** is not in the range of り . However, the differentiation 
map 5 と (の 。(R), の ,(R) ) defined by 5p = ア is surjective, because its range 
eduals ア ,(R), which is the vector space into which 5 maps. 


5o7776 の 6O//e 745e 777e 767777 0777 の, 777C7 
77674 ゞ 777e y7776 の 5 ゞ 4776C77U6. 


77777 の 277677727 777eo7e77 O/ 776 の 7 ル 72/y 


The next result is so important that it gets a dramatic name. 


3.21 77 の 2777e777/ 777eO7e777 O/ 77267 7777 の 9 


Suppose V is fnite-dimensional and7 と 々 ( じ W). Then range 7 is fimite- 
dimensional and 


dm ソニ = dimnul イ 7+ ィ dimrange ア 


Proof Let ,…。 計 。be a basis of null 了 7 thus dimnull イ ザー テカ. The hnearly 
independent list 7 ,.……, Can be extended to a basis 


ーッ の 1 っ の 


of (by 2.32). Thus dim ソ = カカ +7. TO complete the proof, we need to show that 
range 了 is finite-dimensional and dimrange7 =7. We will do this by proving 
that 7 の 」, .…, 7?, 1S a basis ofrange 

Leto リ V Because 7 の] っ の 。 SDans / we can write 


りー 4 キー の 2。 キ の キー キ ち の 
where the〆s and の sareinF. Applying 7 to both sides of this equation, we get 
7? = 7 の キー キル ち 76,, 


where the terms of the form 7 disappeared because each is in null 7. The 
last equation implies that the list 7?」 ,… 7 の, Spans range 了 ア . In particular, range 了 
is finite-dimensional. 
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To show 7o」, .…, 7?, 1S Hinearly independent, suppose C」, ……, c,  F and 
7 の キオ … キ 7 =0. 


Then 


(4 の キー キロ の ) ニ 0. 


Hence 
の キオ … キ の null 7 


Because 4」,…, 4 SDanS null 7, we can Write 
の キー キロ の 三 本 生 キー の 


where the ヴ s are in F. This equation implies that all the cs (and の s) are 0 
(because 2 … の] …) の 15 hnearly independen0). Thus 7?」, .…,7o, is hnearly 
independent and hence is a basis of range 了 , as desired. 


Now we can show that no Hinear map from a fimite-dimensional vector space 
to a “smaller” vector space can be injective, where “smaller'” is measured by 
dimension. 


3.22  /7eg7 7 の 7 の 6 /Oe7- の 77776725707797 Ce 75 7207 77776C77Y 


Suppose " and MW are finite-dimensional vector spaces such that 
dm > dim WW. Then no Hinear map from to W is injective. 


Proof Let7 と EZ W). Then 
dimnul イ アテ dm ソー dimrangse 了 
> dim ソ ー dim WW 
> 0, 


where the first line above comes from the fundamental theorem of Hinear maps 
(3.21) and the second Hne follows from 2.37. The inequality above states that 
dmnul イ アッ >0. This means that null 了 contains Vectors other than 0. Thus 7 is 
not injective (by 3.15). 


3.23 example: /7eg7 7 の 7o77 FT 7o EZs 07 77ec が ve 


Define a linear map7:FH っ Eby 
了 (Z」, 2 っ , 2Z3, 24) 三 (VZz 十 Z2。 十 2Z4, 97z」 二 32。 二 22。,Z。 十 6Z。 十 Zz。 ). 


Because dimEF* > dimF3 we can use 3.22 to assert that 7 is not injective, without 
doing any calculations. 
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The next result shows that no hnear map from a fimite-dimensional vector 
Space to a “bigger'” vector space can be surjective, where “bigger” is measured by 
dimension. 


3.24  /7e7 7 の 7 の 6 /77g7767- の 77776757O727/ 5D7Ce 7 72O7 S77776C77De 


Suppose V and MW are finite-dimensional vector spaces such that 
dmV ソ < dim WW. Then no linear map from V to MW is surjective. 


Proof Let7 好 と (WW). Then 
dimrange7= dim ソーdimnull 了 7 


< dm ソ 
< dim WW 


where the equality above comes from the fundamental theorem of linear maps 
(3.21). The inequality above states that dimranse7 < dim W. This means that 
range 了 cannot equal W. Thus 了 is not surjectiVe. 


As we will soon see, 3.22 and 3.24 have important consequences in the theory 
of Hinear equations. The idea is to express questions about systems of linear 
equations in terms of linear maps. Let's begin by rephrasing in terms of hnear 
maps the question of whether a homogeneous system of hnear equations has a 
nonzero solution. 


Fix DOS1HVe 1ntCgerS 77 and ヵ 。 and let 万 7770ge776074S, 7 77779 CO77767, 777677 ゞ 


4 ょ EF for チ 1,… っ 7 and た 三 1 7 訪 Z7 太 e cos777 7e777 の 7 妨 e 77g/77 se 
Consider the homogeneous system of lin- 、。/。zc ヵ egwg7io7 の e/oy 7s 0. 


ear eduatiOns 


7 
b 当 の で 前 の 三 0 
た =1 


7 
b 2 た ヒー 0. 
k=1 
Clearly xy, ニ … ニ = ニャ ァ , = Uisa solution of the system of equations above: the 


question here is whether any other solutions exist. 
Defne7: EE っ EHP by 


7 7 
3.25 (Wan) 一 ( 1 たら … ッ っ 〉. 4xa 
た =1 た =1 


The equation 7(y」,.…,y,) 0 (the 0 here is the additive identity in Fnamely, 
the Hist of length 7 of all 0's) is the same as the homogeneous system of hnear 
eduations above. 

Thus we want to know fnull 了 is strictly bigger than {0}, which is equivalent 
to 了 not being injective (by 3.15). The next result gives an important condition 
for ensuring that 7 is not injective. 
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3.26 77777O8e726O77 ゞ SYS76772 0/ /77767 6774777O779 


A homogeneous system of linear equations with more variables than equations 
has nonzero solutions. 


Proof Use the notation and result from the discussion above. Thus 7 is a hnear 
map from F" to F" and we have a homogeneous system of 7 linear equations 
with 7 Variables r」, …, From 3.22 we see that 7 is not injective カッ 7 が 7. 


Example of the result above: a homogeneous system of four hinear equations 
with five Variables has nonzero solutions. 

Now We consider the question of 77/2 の 7720ge726074 ゞ , 9 756 の 777 7777S CO77- 
whether an inhomogeneous System of lim- 7eX7, 77677S 27 776 CO7257277 767772 の 77 
ear eduations has no solutions for some 訪 。 zz77 sde og7 7egs7 oe 69G77O7 
choice of the constant terms. To rephrase je/ow 2oes 7o7 eggg7 0. 
this question in terms of a linear map, fix 
Positive integers 77 and 7, and let 4 。EFforall7=1,…,77 and al た =1,…,7. 


7 
For c」,…,c。  F, consider the system of linear equations 


2 の です ナー タム | 
た = 
3.27 
7 
か 4 kk 三 C 訪 
た =1 


The question here is whether there is some choice of c」,.…,c, 己 F such that no 
solution exists to the system above. 


Define7:F っ FPasm3.25. The 77e 7ey7/7s 3.20 g7 の 3.28, 7c77 CO777- 


equation (て ) (6) 15 the の 7e 77e 77777 の e7 o/ vg77 の の /es g77 の 


Same as the system of equations 3.27. 、 訪 。 訪 廊 pe7 の 7 eg9g77o75,。 cg? g75o 
Thus we want to know 計 range ザ チ FE" pe pyoveg sg Ogz4ssZ7 eg- 
Hence we can rephrase our question 7o7. 777e の の 77C7 の の 7 の 9C77 7 ん 677 7e7e 
about not having a solution for some seezs 7O p7ove c/e7267 7 の の 7 な . 
choice of c」,…,o。 Fas follows: What 

condition ensures that ア is not surjective7 The nextresult gives one such condition. 


3.28 7777O777086776O77 ゞ YS76777 0/ 777767 6974 の 77O775 


An inhomogeneous system of linear equations with more equations than 
Variables has no solution for some choice of the constant terms. 


Proof Use the notation and result from the example above. Thus 7 is a Hinear 
map fromF" toF7 and we have a system of 7 equations with 7 Variables テ 」,…, 
From 3.24 we see that 了 is not surjective 7 < 7 が . 


Example ofthe result above: an inhomogeneous system of five linear equations 
with four variables has no solution for some choice of the constant terms. 
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re7C7yey う ア 


ココ - の の ウ 忌 


10 


11 


12 


13 


14 


15 


Give an example of a Hinear map 了 with dimnull7 =3and dimrange ア =2. 

Suppose 5,7 と (P) are such that range S て null 李 Prove that (57)^ = 0. 

Suppose の ,…。 の 1S a Hist of vectors in Define 了 と の (F ウ UP) by 
(る 。) 三 210」 二 … 十 る の 


777 “777* 


(a) What property of 了 corresponds to の 」,.…, の 。 SDanning ソ ? 
(b) What property of 7 corresponds to the Hst o」,…, の being linearly 
independent? 


Showthat 人 7 と る 々 (R3 R3) : dim null7 > 2) is nota subspace of 々 (RY R3). 
Give an example of 7  /(R$) such that range7 = null ア 
Prove that there does not exist 了  (R) such that range 7 =null 好 


Suppose " and W are fnite-dimensional with 2 < dimV < dim W. Show 
that 島々 (WW) : 好 is not injectve) is not a subspace of (V W). 


Suppose and W are finite-dimensional with dim ソ > dm W > 2. Show 
that 島 と の W) : 李 is not surjective) is not a subspace of (VMW). 


Suppose 7 と 々 (V W) is injective and の ,…, の 1S hnearly independentin 
Prove that 7o」,.…, 了 ?, is Hinearly independent in W. 


Suppose の ], …。 の, SDans and と ん (W). Show that 7 の 」,… の, SDans 
range. 


Suppose that Vis fimite-dimensional and that 了 と る 々 (V W). Prove that there 
exists a subspace of such that 


nnul イ アザ テ (0) and range7= テ 人 (7: けけ). 
Suppose 7 is a linear map from F* to F2 such that 
MMlT' 三 (6) 年 本 ーー Band%。 テー 7 
Prove that 了 iS surjective. 


Suppose U is a three-dimensional subspace of R” and that 7 is a linear map 
from R to R? such that null 7 = ロロ . Prove that 7 is surjective. 


Prove that there does not exist a linear map from F? to FE whose null space 
GU2lR (ET.92。25。2。 45) 寺本 うー 9 amd ニニ ルト 


Suppose there exists a linear map on whose null space and range are both 
jimite-dimensional. Prove that is finite-dimensional. 


16 


17 


18 


19 


20 


21 


22 


23 


24 


25 


26 


27 
28 
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Suppose V and W are both finite-dimensional. Prove that there exists an 
injective Hinear map from to Wifand only if mV < dim Wi. 


Suppose " and W are both finite-dimensional. Prove that there exists a 
surjective linear map from onto W if and only if dim ソ ッ dim W. 


Suppose " and MW are finite-dimensional and that Uis a subspace of 
Prove that there exists 7 々 (VW) such that null ア = テロ and only if 
dim ソ > dimY ーー dim W. 


Suppose 【W is finite-dimensional and 了 と の (W). Prove that 7 is injective 
i and only ithere exists S と 々 (W,) such that 57 is the identity operator 
on 


Suppose W is finite-dimensionaland 了 7 と 々 (W). Prove that 了 is surjective 
if and only ithere exists 5 と 々 (WW,) such that 7S is the identity operator 
on W. 


Suppose V is finite-dimensional, 了 7 と W), and Uis a subspace of W. 
Prove that (の と モ : To と) is a subspace of and 


dimto と りり:7o と ) = dimnul ザ + ォ dim(U nrange7). 


Suppose and are finite-dimensional vector spaces and5 と (WW) and 
了 と (人 革 ). Prove that 


dimnullS7 < dimnull 5 + dimnul1 ア 7 


Suppose and are finite-dimensional vector spaces and5 と (WW) and 
了 と (信じ ). Prove that 


dimrange 57 < mintdim range 5, dimrange 了 ). 


(&) Suppose dim ソ =5and5, ア 7 と イズ () are such that 5 ア 7 =0. Prove that 
dimrange7S < 2. 
(b) Give an example of 5,7 と (FE?) with 57 =0anddimrange7S = 2. 


Suppose that W is finite-dimensional and 5.7 と 々 (WW). Prove that 
nullSC て null7 if and only 症 there exists E と 々 (W) such that 了 = ES5. 


Suppose that is finite-dimensional and 5,7 と (WW). Prove that 
rangeSCrange7 了 fand only ifthere exists E 三 ん ( じ ) such that 5 ニア 5. 


Suppose P と () and P テ = P. Prove that ニーn ロ ullP @ range ア . 


Suppose り と 々 (アア (R)) iS such that deg Dp = (deg ヵ ) 一 1 for every non- 
constant polynomial ヵ の (R). Prove that り is surjectiVe. 
77e 7 の 7477O77 リ 75 ye g の ove 7 の 7e77777 の yo7 の 7 77e 7e7777777O77 7 の の 777 
se77 の 5 の の /D72O77777 7 の 


29 


30 


31 


32 


33 
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Suppose ア (R). Prove that there exists a polynomial 7 ア (R) such 
that 57" 37 ニル. 
7775 ere7c7Se C74 の e do7e 7777O747 /7e47 7ge の 7 の , の 7 77 Y 77 の 7 777 7O の の 7 
747728 7776g7 g/oe の 7 の . 


Suppose の 々 (FE) and ゅ 0. Suppose z is not in null の . Prove 
that 
=nul み の @ 人 (27 :gF). 


Suppose V is fimite-dimensional, X is a subspace of and Yis a fnite- 
dimensional subspace of W. Prove that there exists 7 と 々 (, W) such that 
nul イ アー ニ andrangee ア 7 アー ェ Yifand only dim※+ dimY= dm 


Suppose V is finite-dimensional with dim ソ > 1. Show thatf ゅ : る ん ( ゆ ) っ 
is a hnear map such that の (57) = の (5) ゅ g) for al 5,7 ん ( ゆ ), then 
の =0. 

万 7 77e eyc77D777 の 77e 7yO-s7 の e7 77eg/5 の 7 る () ge7 か Ye7c7se 7/ 

77 Sec7 の 7 24 777g77 の e 745e774/. 


Suppose that and W are real Vector spaces and7 と 々 (WW). Defne 
J ナ c(7 二 7 の ) ニナ 7 二 7 の 
for all oo と 


(&) Show that 7c is a (complex) Hnear map from Vc to Wc. 
(b) Show that 7。 is injective if and only 了 is injective. 
(c) Show that range 7。 = Wc ifand only ifrange ア = MW. 


See 万 ィ e7C7Se 9 7 Sec77 の 77 7 /7 77e 6777777O77 の 7 77e co7 の 7er77 が cg77O77 VC. 
77e /77eg7 7 の の 7C 75 Cd77ed 7e co7 の /er777cg7 の 77 の 7 77e 777e7 7 の 李 
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e/7eye777777g 0 7776g7 7 の の y g 74777 


We know that 症 o」,…, の , 1S a basis of and 了 7: レー Wis Hinear, then the values 
of 7 の 」,… 7 , determine the values of 了 on arbitrary vectors in ソー see the hnear 
map lemma (3.4). As we will soon see, matrices provide an efcient method of 
recording the values of the 7o。s in terms of a basis of WI 


3.29 definition: 77277 ル , 人 4 


SuDPOSse 77 and 77 are nonnegative integers. An 77-by-7 7 が 77 人 4 1s a rectangular 
array of elements of F with 77 rows and 7 columns: 


人 4 ュ ゆ が 人 41。 
4=| : 
生 DO0 2 


The notation 4 , denotes the entry in row 7, column た of 人 4. 


3.30 example: 4 。 e9/ 67777Y 7 7O ツ Co た の 4 


S 人 呈 8 4 5-37 
MNO ー 1 9 7 ・ W7e7 eg77g 777 7 の 777Cey, 777e 77757 
Thus 4。 。 refers to the entry in the sec- er 7e/67 ゞ 7 の 777e 7 の W 7777 の 7 7 が 0e yec- 
ond row, third column of 4, which means O79 777ex 7e/e7 ゞ 7 の 777e CoO77477777 7777777 の 6 た 
that 2 3 三 7. 


Now we come to the key definition in this section. 


3.31 definition: 7G777r の げ g 7777eg7 7 の の 7 (7 ) 


Suppose 7 々 (V W) and o」,…, の 。 1S a basis of V and の 」,.……, の 1S a basis 
of W. The 27 の 7 with respect to these bases is the 77-by-7 matrix 7(7) 
whose entries 4 , are defned by 


Jo 一 4 k の 1 上 なら < 0 


the bases o」, .……, の, and の の] .…, の 8Te not clear from the context, then the 
notation 7( 了 , (の ], …, で の) (の 1 …, の 。) ) 1S USed. 


The matrix 27 7) of a hinear map7 と 々 (W) depends on the basis の 」, .…, の , 
of and the basis の 」, .…, の, Of W, as well as on 7. However, the bases should be 
clear from the context, and thus they are often not included in the notation. 

To remember how 7 ず ) is constructed from 了 , you might write across the 
top of the matrix the basis Vectors の , ……, の , for the domain and along the left the 
basis vectors の 」, …, の, for the vector space into which 7 maps, as follows: 
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(2 PE (2 PE の / 
Ci 4 ん 
の 記 の 


In the matrix above only the col- 
umn is shown. Thus the second index of 
each displayed entry of the matrix above 
is た. The picture above should remind you 8 
that 7o, can be computed from 7 7) by To = 2 4.x の - 
multiplying each entry in the column 0 
by the corresponding の , from the left co ト - 
umn, and then adding up the resulting 
Vectors. 

7 is a hnear map from F” toF ウ が 7 jp 9 太 eg7 op 7op gi 
then unless stated otherwise, assume the 7sjo7g7 pee7o チ pgce 7O g 
bases in question are the standard ones 訪 2ezsfo7g7 vec7o7 spgce, 7 
(where the た "basis vectoris1inthekm 277) pg 7 の -7 7 
slot and 0 in all other slots). If you think 
of elements of F as columns of 7 numbers, then you can think of the 名 column 
of 77(7) as ア applied to the standard basis vector 


3.32 example: 7 カ e 77r の 7 777ed7 7 の 万 o77 F< 7o FE? 


Suppose 7 と 々 (FE2E?) is defined by 


77e 7 co/77 の 27(7) co7ss が sy o/ 
娘 e scd/27y 7eege 7O W777e 7 の 。 の 5 の 
7777e7 CO77 の 777777 の 7 の 7 の] …。 の の: 


了 (Y,) ニ (て 37, 2 5y, 7 ァ + 9 の ). 


Because 了 (1.0) = (1,2,7) and ア (0,1) = (3,5, 9), the matrix of 了 with respect 
to the standard bases is the 3-by-2 matrix below: 


1 3 
wm-| : | 
7 9 


When working with ア ,(F), use the standard basis 1,*,* ろ .…, 7 unless the 
context indicates OtherWise. 


3.33 example: 7 の 7 77e の 7 が 7e77727 が 7 7 の の 方 o77 の 5(R ) 7o の 5(R) 


Suppose り と 々 ( グ の 。(R), み (R)) is the differentiation map defined by り p = の 
Because (*“7)” = ゲー1 the matrix of り with respect to the standard bases is the 
3-by-4 matrix below: 


0 1 0 0 
77 の の )=| 0 0 2 0 |. 
0 0 0 3 
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AZ777o77 7 の 5cg/27 7777 の 77c77O77 の 7 72777cCey 


For the rest of this section, assume that /, /, and W are finite-dimensional and 
that a basis has been chosen for each of these vector spaces. Thus for each linear 
map from to WW, we can talK about its matrix (With respect to the chosen bases). 

Is the matrix of the sum of two Hinear maps edual to the sum of the matrices of 
the two maps? Rigsht now this question does not yet make sense because although 
we have defined the sum of two Hnear maps, we have not defimed the sum of two 
matrices. Fortunately, the natural definition of the sum of two matrices has the 
right properties. Specifically, we make the following defnition. 


3.34 definition: 7772777 の 7777 の 77 


The s77 の ny の 77 の 77cey の 7 77e yg77e s7Ze 1S the matrix obtained by adding 
corresponding entries in the matrices: 


2 NND ii 凍 eo 


gh : 8 
(6 時 uo (6 入 衣 


NN 0 Po の Eee 


| は (8 


In the next result, the assumption is that the same bases are used for all three 
jinear maps S + 了 , 5, and 了 李 


The verification of the result above follows from the defimitions and is left to 
the reader. 

Still assuming that we have some bases in mind, is the matrix of a scalar times 
a hnear map equal to the scalar times the matrix of the linear map? Again, the 
question does not yet make sense because we have not defned scalar multiplcation 
on matrices. Fortunately, the natural definition again has the right properties. 


3.36 definition: scg/7 777777 の /7cg77O77 の 7 9 77777Y 


The product of a scalar and a matrix is the matrix obtained by multiplying 
each entry in the matrix by the scalar: 


5 002 
ん ロ ョ ロ 較 


4 2 


2 ni 2 77。77 77。77 
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3.37 example: 777O77 7 の scg/7 7777777 の 77C の 77O77 の / 779777C6y 


うう 1 / 和 人 す 2)- こ 0 6 2 さ (を 2) 了 10 4 
ー-1 5 1 6/ \ -2 10 1 6/ \-1 16 
In the next result, the assumption is that the same bases are used for both the 

jnear maps A7 and 子 


3.38 77e 77G777X O/ の scd/27 7777765 の 777767 7777 の 


Suppose ん 三 Fand 了 7 アーバ (WV). Then (47 ) = 477⑦). 


The verification of the result above is also left to the reader. 

Because addition and scalar multiplication have now been defined for matrices, 
you should not be surprised that a Vector space is about to appear. First we 
introduce a bit of notation so that this new Vector space has a name, and then we 
jind the dimension of this new vector SDace. 


3.39 notation: F の 7 


For 7 and 7 positive integers, the set of all 娘 -by-7 matrices with entries in F 
is denoted by F"" 


95740 匠 lll 人 新 7777 


Suppose 77 and 77 are DOsitive integers. With addition and scalar multiplication 
defined as above, FE の? is a vector space Of dimension 7777. 


Proof The verification thatF の 7 iS a Vector space is left to the reader. Note that 
the additive identity of F の "is the 77-by-7 matrix all of whose entries equal 0. 

The reader should also verify that the list of distinct 77-by-7 matrices that have 
0 in all entries except for a 1 in one entry is a basis ofF の There are 7 such 
matrices, so the dimension of F の 7 equals 777. 


47 万 77777 の 7cg77O7 


SuDpOSe, aS Dreviously, that の 」,…, の, 1S a basis of and の ],…, の 15 a basis of W. 
Suppose also that n,…。4 15 a basis of 

Consider lnear maps 了 テリ ロー っ ー ザ ツ and5: ソ ソー WW. The composition STis a 
inear map from / to WW. Does 77(57) equal 77(5) 77(7)7 This question does 
not yet make sense because we have not defined the product of two matrices. We 
will choose a definition of matrix multiplication that forces this question to have 


apositive answer. Le''s see how to do this. 
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Suppose 7(5) = 4 and が 77) = p. For 1 < た < ヵ we have 


(S7)x = 5( > Be ) 


777 7 
三 b ( b 当 4.B。g)e 
7 呈 1 =1 
Thus 77(57) is the 娘 -by-p matrix whose entry in row /, column た , eduals 
/4 
b 当 4 5 
ァ ニ =1 


Now we see how to define matrix multiplication so that the desired equation 
7(57) = 7(5)77⑦) holds. 


3.41 definilion: 7 が 7 な 777777//7Cg77O72 


Suppose 4 is an 77-by-7 matrix and is an 7-by- matrix. Then 4P is defined 
to be the 7-by-pmatrix whose entry in roW 7, column た , is given by the equation 


7 
(45): 。 三 泊 2 : 
78 王 ) 


Thus the entry in row 7, column ん of 4P is computed by taking row of 4 and 
column た of ぢ , multiplying together corresponding entries, and then summing. 


Note that we defne the product of 727 7 2ve /eg7726 77775 6777777O77 
two matrices only when the number of の 7 7 が 7774777 の 7CG77O72 72 972 6777e7 
columns of the frst matrix equals the cose, g/7o4g7 yo の 77 gue 
number of rows of the second matrix. see7 5 77o7U7 が oO7 67 が 


3.42 example: 77977X 727777 の 77cg77 の 7 


Here we multply together a 3-by-2 matrix and a 2-by-4 matrix, obtaining a 
3-by-4 matrix: 


iL 入 10 7 4 1 
E 人 | 人 M 19 12 | 
5 6 42 31 20 9 


Matrix multiplication is not commutative--4p iS not necessarily equal to 
jp even if both products are defined (see Bxercise 10). Matrix multiplication is 
distributive and associative (see Bxercises 11 and 12). 
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In the next result, we assume that the same basis of Vis used in considering 
7 々 (の) and 5 三 /( ゆ W), the same basis of W is used in considering 
5 と ZZ(W) and 57 和 々 (U, W), and the same basis of is used in considering 
了 イ ズバ ( ル じ ) and 57 和 々 (, W). 


3.43 77 克 の 7/7Od の 7zc7 o/ 777e の 7 777 の の 9 


7 と (の ) and 5 E 々 ( W), then 7(57) = (5)77 7). 


The proof of the result above is the calculation that was done as motivation 
before the definition of matrix multplication. 

In the next piece of notation, note that as usual the first index refers to a row 
and the second index refers to a column, with a Vertically centered dot used as a 
placeholder. 


3.44 notation: 4 , 4 。 


Suppose 4 is an 7-by-7 matrix. 


* f1 く ) く 刀 ,then 4 denotes the 1-by- ヵ matrix consisting ofrow 7 of 4. 


ef1 こく た く ヵ then 4. denotes the 77-by-1 matrix consisting of column た 
of 4. 


3.45 example: 4 . ez75 攻 zow の 4 gz の 4., eggg7s 7 co/7 の 4 


The notation 4。 . denotes the second row of 4 and 4.> denotes the second 


column of 4. Thus 4 = ( 昌和 | then 


1 9 Z 


4 

4。.=(1 9 ?Z) and 人 ) 

The product of a 1-by- ヵ matrix and an 7-by-1 matrix is a 1-by-1 matrix. How- 
ever, we will frequently identfy a 1-by-1 matrix with its entry. For example, 


6 


(3 4)( 5 =(2) 


because 3・6+4・2 = 26. However, we can identify ( 26 ) with 26, writing 
6 
(3 4 )( 6 ) の 
The next result uses the convention discussed in the paragraph above to give 
another way to think of matrix multplication. For example, the next result and 
the calculation in the parasraph above explain why the entry in row 2, column 1, 
of the product in Example 3.42 equals 26. 
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3.46  e777y の 7 772777Y の 7 の 7/C7 974/9 7OW 7777765 CO77777777 


Suppose 4 is an 77-by-7 matrix and is an 7-by- ヵ matrix. Then 


(4 の ) ょ = 人 4. 


if1 </ く 7 and 1 < た く か ヵ . In other words, the entry in row /, column ん of 
4p equals (row / of 4) times (column た of ぢ ). 


Proof Suppose1</ く 7and 1 < た く <p ヵ . The definition ofmatrix multiplication 
states that 


3.47 (48) ょ ニル 411 を キー キ 4 


リ 有 5/ き / 有 5/ 
The definition of matrix multiplication also implies that the product of the 1-by- ヵ 
matrix 4 and the 7-by-1 matrix p., is the 1-by-1 matrix whose entry is the 
number on the right side of the equation above. Thus the entry in row / column ん 
of 4p equals (row / of 4) times (column た of ). 


The next result gives yet another way to think of matrix multiplication. In the 
result below, (48)., is column た of the 7-by カ matrix 4p. Thus (4 ぢ ). is an 
77-by-1 matrix. Also, 4P.,iS an 77-by-1 matrix because it is the product of an 
77-by-7 matrix and an 7- 中 1 matrix. Thus the two sides of the equation in the 
result below have the same size, making it reasonable that they might be equal. 


3.48 co/z77777 の 7777 克 7 の 4C7 6 の 77975 7777/ 7777769 CO77777777 


Suppose 4 is an 77-by-7 matrix and is an 7-by- ヵ matrix. Then 


(4 の の) , = 4 が .。 


if] < た く ヵ . In other words, column た of 4P equals 4 tmes column た of . 


Proof As discussed abovVe, (45)., and 4p 。 are both 77-by-1 matrices. If 1 < 
7 ミ 77。 then the entry in row 7 of (48). , is the left side of 3.47 and the entry in 
row 7 of 4 ,is the right side of 3.47. Thus (45) , = 4p 


Our next result will give another way of thinking about the product of an 
7 が -by-7 matrix and an 7-by-1 matrix, motivated by the next example. 


3.49 example: 7ogc7 の げ 6 3- の y-2 7 が 7 の 6 2- の y-1 7 が 7 巡 


Use our definitions and basic arithmetic to verify that 


け は BkH 


Thus in this example, the product of a 3-by-2 matrix and a 2-by-1 matrix is a 
jinear combination of the columns of the 3-by-2 matrix, with the scalars (5 and 1) 
that multply the columns coming from the 2-by-1 matrix. 


76 Chapter3 Linear Maps 


The next result generalizes the example above. 


3.50  /77e7 CO777 の 774777O77 の 7 CO/74777779 


ム 


Suppose 4 is an 77-by-7 matrix and り = 


| is an 7-by-1 matrix. Then 


0 三 0M4 leo10 4 


In other words, 4 is a Hinear combination of the columns of 4, with the 
scalars that multiply the columns coming from ち ヵ . 


Proof _ せ た {1, .…,77), then the definition of matrix multiplication implies that 
the entry in row た of the 7-by-1 matrix 4 り is 


4 リュ 好 二 aic ポ Ak 


7 


The entry in row た of 4 」 キ …+ ち 4 。 also equals the number displayed above. 
Because 45and 太 4 キー+ ル 4 have the same entry in row た for each 
ke 人 1,…, 刀 )。 We conclude that 45 ち = ニ ち 4 コキ オ …ー+ ォ 万 4 


Our two previous results foOcus on the columns of a matrix. Analogous results 
hold for the rows of a matrix. Specifically, see Exercises 8 and 9, which can be 
proved using appropriate modifications of the proofs of 3.48 and 3.30. 

The next result is the main tool used in the next subsection to prove the 
column-row factorization (3.36) and to prove that the column rank of a matrix 
eduals the row rank (3.57). To be consistent with the notation often used with the 
column-row factorization, including in the next subsection, the matrices in the 
next result are called C and Kinstead of 4 and ぢ . 


3.51 77 777777 の /7C77O72 5 77767 CO777 の 777977O775 の 7 CO/74777779 


Suppose C iS an 77-by-c matrix and R is a c-by-7 matrix. 


(a) Hf 古人 1,.…7, then column of CR is a linear combination of the 
columns of C, with the coeficients of this linear combination coming 
from column ん of RA. 


(b) 7 6 人 1,.…,7), then row / of CR is a Hinear combination of the rows of 民 , 
with the coeficients of this linear combination coming from row 7 of C. 


Proof Suppose た 人 1,.…7. Then column た of CK equals CK. , (by 3.48), 
which equals the hinear combination of the columns of C with coefcients coming 
from K. , (by 3.50). Thus (a) holds. 

To prove (b), follow the pattern of the proof of (a) but use rows instead of 
columns and use Exercises 8 and 9 instead of 3.48 and 3.30. 
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Co/777777 一 Aow 7C7O77<77O77 の 747 が g77 ん た 7 77477 ん 


We begin by defining two nonnegative integers associated with each matrix. 


3.52 definition: co77777777 7 ん 7Ow 7 ん 


Suppose 4 is an 7 が -by-7 matrix with entries in F. 


e The co/7777 7 の 77 ん of 4 is the dimension of the span of the columns of 4 
im は 


e The 7ow 7 ん of 4 is the dimension of the span of the rows of 4 in FT 


T 4 is an 娘 -by-7 matrix, then the column rank of 4 is atmost 7 (because 人 4 has 
7 columns) and the column rank of 4 is also at most 77 (because dimF の トニ カカ). 
Similarly, the row rank of 4 is also at most mint77。7). 


3.53 example: co/7772 7 ん 7 7 の 77 ん の が g 2- の y-4 7 の 7 


SUDDOSe 
4 7 1 8 
( 3 5 2 9 ) 


The column rank of 4 is the dimension of 


w(G の 0)⑧) 


in F2 ト Neither of the first two vectors listed above in F 人 1 is a scalar multiple of 
the other. Thus the span of this list of lengsth four has dimension at least two. The 
span of this list of vectors in F 全 ! cannot have dimension larger than two because 
dimF^「 = 2. Thus the span of this list has dimension two, which means that the 
column rank of 4 is two. 

The row rank of 4 is the dimension of 


span(( 4 | 8 Ja し 披 思 9 )) 


in F+3 Neither of the two vectors listed above in Fis a scalar multiple of the 
other. Thus the span of this list of length two has dimension two, which means 
that the row rank of 4 is two. 


We now define the transpose of a matrix. 


3.54 definition: 7g7spose, 4【 


The 7 ヵ gzsypose of a matrix 人 4, denoted by 人 4! is the matrix obtained from 4 by 
interchanging rows and columns. Specifically, if 4 is an 娘 -by-7 matrix, then 
人 4 is the 7-by-77 matrix whose entries are given by the equation 


(4 二 0 
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3.55 example: 72775POse の げ G 72977 


5 一 Z 

ra-| 3 8 ee-( 3 8 の ) 
ー4 2 

Note that here 4 is a 3-by-2 matrix and 4' is a2-by-3 matrix. 


The transpose has nice algebraic properties: (4+) = パオ +B5(A4)「 = AA 
and (4C) = CI4「 for all 娘 -by- ヵ matrices 4,p, all えと FE, and all7-by- matrices 
C (see Exercises 14 and 15). 

The next result will be the main tool used to prove that the column rank equals 
the row rank (see 3.57). 


3.56 co/z77777 一 7 の 7277O77Z77O77 


Suppose 4 is an 77-by-7 matrix With entries in F and column rankc > 1. Then 


there exist an 77-by-c matrix C and a c-by-7 matrix KR, both with entries in E, 
such that 4 = CR. 


Proof Each column of 4 ijS an 娘 -by-1 matrix. The list 4,…,4. , of columns 
of 4 can be reduced to a basis of the span of the columns of 4 (by 2.30). This 
basis has length c, by the definition of the column rank. The c columns in this 
basis can be put together to form an 77-by-c matrix C. 

TE {1,…, 妃 , then column た of 4 is a linear combination of the columns 
of C. Make the coefcients of this linear combination into column た of a c-by-7 
matrix that we call R. Then 4 = CR, as follows from 3.51(a). 


Im Example 3.53, the column rank and row rank turned out to equal each other. 
The next result states that this happens for all matrices. 


3.57 co/z77772 74777 e977/9 7 の 7777 ん 
Suppose 4 EE Then the column rank of 4 equals the row rank of 4. 


Proof Letc denote the columnrankof4.Let4 = CRbethe column-row 
factorization of 4 given by 3.56, where Cis an 7 が -by-c matrix and 尺 is ac-by-7 
matrix. Then 3.51(b) tells us that every row of 4 is a linear combination of the 
rows of KR. Because has c rows, this implies that the row rank of 4 is less than 
or equal to the column rankc of 4. 

1o prove the inequality in the other direction, apply the result in the previous 
paragraph to 4 getting 


column rank of 4 =row rank of 4「 
< column rank of 4「 


三 roOw Tank of 4. 


Thus the column rank of 4 equals the row rank of 4. 
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Because the column rank equals the row rank, the last result allows us to 
dispense with the terms “column rank” and "Tow ranK” and just use the simpler 
term "TanK" 


3.58 definition: 77 記 


The 7 た of amatrix 4 FE の 7 is the column rank of 4. 


See 3.133 and BExercise 8 in Section 7A for alternative proofs that the column 
rank equals the row rank. 


re7c7yey うじ 


1 Suppose 了 と る 々 (W). Show that with respect to each choice of bases of レ 
and W, the matrix of 了 has at least dim range 7 nonzero entries. 


2 Suppose and W are jnite-dimensional and 7 と 々 (WW). Prove that 
dimransge7 = 1 if and only if there exist a basis of and a basis of W such 
that with respect to these bases, all entries of 7( ず 7) equal 1. 


3 Suppose の ],…, の, 1S a basis of and の ,… の 1S a basis of W. 


(a) Show thatif 5, 了 EE バ (KW), then 77(5 + ア ) = (5) + 7(7). 
(b) ShowthatifAEFand ず 7 と (WW), then 7(A ア 7) = AZ(7). 


777o ee7C7/Se yy YO 7 の Ve7 が y 3.35 7 3.3@. 


4 Suppose that り と 々 (の (R), み (R)) is the differentiation map defined by 
D ヵ = ニ p" Find a basis of の 。(R) and a basis of の 5(R) such that the matrix of 
with respect to these bases is 


1 0 0 0 
0 1 0 0 |. 
0 0 1 0 


Co77 の 7e 7777 太 YG777/e 3.33. 77e 77eX7 6Y@7C/Se g67267 の 77Zey 77775 eX67C7Se. 


S Suppose and W are finite-dimensional and 了 7 と (VMW). Prove that there 
exist a basis of and a basis of W such that with respect to these bases, all 
entries of 7 (7) are 0 except that the entries in row た column た, equal 1 if 
1 < ん < dimranee 了 ア 


6 Suppose の ,…, の 1S a basis of Vand MW is fimite-dimensional. Suppose 
了 と (WW). Prove that there exists a basis の 」, .…, の , Of W such that all 
entries in the first column of 77 (7) [with respect to the bases の 」, …, の, nd 
の … っ の | are 0 except for possibly a 1 in the frst row, frst column. 

7 7775 ere7c/e, 77277Ke 万 e7C7ye う , YO 76 ge77 777e の yy の 7 7757egg の 7 
eg 9 の /e 7 の cooyeg の gs75 の 


い リ 


10 
11 


12 


13 


14 
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Suppose の 1, …, の 。 1S a basis of W and Vis fimite-dimensional. Suppose 
了 ズ (WW). Prove that there exists a basis ?」, .……, の Of V such that all 
entries in the frst row of 7 (7) [with respect to the bases の], …, の and 
の … っ の | are 0 except for possibly a 1 in the frst row, frst column. 
7 777s ere7c7se, 7277e 万 e7c7/ye う , OZ 97e 67e72 7e の gy75 の 7 W 7eg の の 7 
eg g7/e 7 の c7ooye 6 の gs75 の WW 


Suppose 4 is an 万 -by-7 matrix and pis an 7-by- matrix. Prove that 
(48),. = 4..g 
for each1</ く 7 の . In other words, show that row of 4 equals (row 7 of 4) 


times p. 


7775 ere7C75e 87Vey 7e 7OW Ve757O7 の / づ . プ 9. 


Supposeg ニ (  … の )iSa1-by-z matrix and Bis an7-by- カ matrix. 
Prove that 
gp 王 g1P」 キ … 十 呈 P 


7 だ 7 に 
Tn other words, show that gp is a linear combination of the rows of jp, with 
the scalars that multiply the rows comins from 7. 


777s ee7C7 が Se ge ゞ 77e 7 の Ye7s7O7 の 7 う . う 50. 
Give an example of 2-by-2 matrices 4 and such that 4B チ P4. 


Prove that the distributive property holds for matrix addition and matrix 
multiplication. In other words, suppose 4, , C, , E, and 了 are matrices 
whose sizes are such that 4(B+ 〇 ) and ( り + 玉 ) チ make sense. Explain why 
4pB+ 4Cand り F+ ErF both make sense and prove that 


4(B+C) = ニ 4B+4C and ( リ + チ = テリ チ + た 


Prove that matrix multplication is associative. In other words, suppose 4, , 
and C are matrices whose sizes are such that (4p)C makes sense. Explain 
why 4(pC) makes sense and prove that 


(48)C = 4(BC). 


7y 7o 万 7 2 c/eg77 7 の の 7 万 7 777457 の 7ey 7e め 77ow777g 4 の 76 放 o77 女 77777 47777- 
"7 が 5 7 が eX の 677674Ce 罰 7 7OO75 DO の ル 7725 77477Cey C77 の e 577O77e77e7 の y 5 う 0% 
が o7ze 777OWy 77e 7 の 777C6y の 7.” 


Suppose 4 is an 7-by-7 matrix and1 く 7 た く 7. Show that the entry in 
row ヵ , column た of 4? (which is defined to mean 444) is 


Suppose 77 and 7 are Dositive integers. Prove that the functon4 ウ トイ isa 
linear map from F777 to FT 光 


15 
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Prove thatif4isan 娘 -by-7 matrix and Cis an7-by- matrix, then 


(4C)' = CAL 
7775 ee7c75e yoOwy 7 7 が 6 7775DO5e の 77e 7 の 7 の / 7 の 727777C@ ゞ 75 77e 
7 の gc7 の 7 77e 77 の 75 の Oy@ ゞ 7 77e6 の の の OS77e の 7 の er た 


16 Suppose 4 is an が -by- れ matrix withA4 チ 0. Provethattherankof4is1 


17 


and only if there exist (c」,.…,c。) Fand ( 生 ,… の.) と F" such that 


4 ょ テニ の for every 了 ニ 1,…, 77 and every た 三 1,…。7. 


Suppose 7 々 (), and 7 ,…, 4 and の … の Te bases of / Prove that 
the following are equivalent. 

(a) 了 is injective. 

(b) The columns of 77) are linearly independent in F 1 

(c) The columns of 77 7) span F“ ト 

(d) The rows of 77 7) span FT 

(e) The rows of 77 7) are linearly independent in FT% 


Here 77 (7) means 27 (7 (4 (の, …。 の ) ) . 
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3 の 77ve777 の 7 の 7 の バ O77O7 の 757775 


77ve777 め /e 7777e7 7 の y 


We begin this section by defining the notions of invertible and inverse in the 
context of linear maps. 


es Alinearmap 了 7 と (VMW) is called ve777 の /e if there exists a hnear map 
5 々 (WP) such that 57 equals the identity operator on and 了 S equals 


the identity operator on W. 


es Ahjinear mapS と る 々 ( 炎 じ ) satsfying S7 = Tand75 = 7is called an 
7ve7ye Of 了 (note that the first 7 is the identity operator on and the second 
7 is the identity operator on W). 


The definition above mentions “an inverse'. However, the next result shows 
that we can chanee this terminology to “the inverse" 


Proof Suppose 了 と 々 (V W) is invertible and 5」 and 5。 are inverses of 了 ア . Then 
5+ ヒー 5」7 ヒー 5」( す 52) 一 (517)5> ヒー 75> ヒー 52. 
Thus 5+ ヒー 52. 


Now that we know that the inverse is unique, We can give it a notation. 


If 7 is invertible, then its inverse is denoted by 7ー!. In other words, 才 


7 了 7 と W) is invertible, then 7ー] is the unique element of 々 (WP) such 
that7ー ザ 7 = 了 and 77ー ト ニー7| 


3.62 example: erse o7 6 77eg7 7 の 7o7 RY 7o R? 


Suppose 7 と 々 (R?) is defined by 了 (,z) = (- ゅ r,4z). Thus ア is a 
counterclockwise rotation by 90* in the xy-plane and a stretch by a factor of 4 in 
the direction of the z-axis. 

Hence the inverse map 7ー! と (R?) is the clockwise rotation by 90* in the 
* り -Dlane and a stretch by a factor of 2 in the direction of the z-axis: 


アー ト ( テ の 2) 三 (一 Y。 3). 
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The next result shows that a Hinear map is invertible if and only it is one-to- 
one and onto. 


3.63 7Zve777 の 7777 を 学 77/ec が 7 が 7 の 577776c77Y77y 


A Hnear map is invertible and only 補 it is injective and surjectHVe. 


Proof Suppose7 と ズバ (WW). We need to show that ア is invertble if and only 
if it is injective and surjectiVe. 
First suppose 了 is invertble. 1o show that is injective, suppose 7 の 生 
and7z = 7o. Then 
ニア ー1(7) ニア ー1(7p) = の, 


SO ニ の . Hence 了 is injectiVe. 

We are still assuming that 了 is invertible. Now we want to prove that 了 is 
surjective. To do this, let の W. Then の = ア (7ーTo), which shows that is 
in the range of 了 ア . Thus range7 = W. Hence ア is surjective, completing this 
direction of the proof. 

Now suppose 了 is injective and surjective. We want to prove that js invertible. 
For each z  W, define 5(cp) to be the unique element of such that 7(5( の ) ) = の 
(the existence and uniqueness of such an element follow from the surjectivity and 
injectivity of7). The definition of 5 implies that ア o 5 equals the identity operator 
on MW. 

To prove that S oequals the identity operator on leto と Then 


7((5 7)?) = 7 oc 5)(7o) = To) = 7o. 


This equation implies that (5s7)o = の (because 了 is injective). Thus 5o ア equals 
the identity operator on 

To complete the proof, we need to show that S is Hinear. To do this, suppose 
の +, の 。 WW. Then 


7(5(< の 1) + 5( の 2)) ニナ (5(< の 1)) + 了 (5(< の >) ) ニ の の > 


Thus 5( の 。) + 5( の 。) is the unique element of that 了 maps to の 」 の っ . By the 
definition of 5, this implies that 5( の 」 + の っ ) = 5( の 」 ) + 5(< の >). Hence 5 satisfies 
the additive property reduired for Hinearity. 

The proof of homogeneity is similar. Specifically, 導 の Wand 和 ん,then 


7(A5(c) ) = A7(S(o) ) = Aco. 


Thus AS( の ) is the unique element of that 了 maps to Ao. By the definition of 5, 
this implies that 5(A) = AS( の ). Hence S is Hinear, as desired. 


For a hnear map from a vector space to itself, you might wonder whether 
injectivity alone, or surjectivity alone, is enough to imply invertibility. On infmite- 
dimensional vector spaces, neither condition alone implies invertibility。 as illus- 
trated by the next example, which uses two familiar lnear maps from Example 3.3. 


84 Chapter3 Linear Maps 


3.64 example: 7e77e7 7 が 7ec が 7V7 が の 7O7 S7776C7 が V7 が の 7 の 77ey re77 の 7777y 


e The multplication by y linear map from の (R) to の (R) (see 3.3) is injective 
but it is not invertible because it is not surjective (the polynomial 1 is not in 
the range). 


e The backward shift inear map from FY to FY (see 3.3) is surjective but it is 
not invertible because it is not injective [the vector (1, 0,0, 0, .… ) is in the null 
SDace | . 


In view of the example above, the next result is remarkable 一 it states that for 
a linear map from a finite-dimensional vector space to a vector space Of the same 
dimension, either injectivity or surjectivity alone implies the other condition. 
Note that the hypothesis below that dimV = dim W is automatically satisfied in 
the important special case where V is finite-dimensional and W = ニ ソ 


3.65 77ec が 7 が 75 69777V/e777 7 の s77776c77y7 の (が dm ソ = dimW < oo) 


Suppose that V and W are finite-dimensional vector spaces, dim V = dim 【W, 
and7 と 々 Z(W). Then 


7 is invertible < っ 7isinjective < っ つ 李 1S surjective. 


Proof The fundamental theorem of Hinear maps (3.21) states that 
3.66 dim ソ = dimnull 7+ dim range 李 


Tis injective (which by 3.1S is equivalent to the condition dimnul ア = テ 0), 
then the equation above implies that 


dimrange7 = dm ソーdimnul7 = dim ソ = dim WI 


which implies that 了 is surjective (by 2.39). 
Conversely, 了 is surjective, then 3.66 implies that 


dimnull7 = dim ソ ーdimrangee ア 7 テニ d の dm ソーdimW =0, 


which implies that 7 is injective. 

Thus we have shown that ア is injective if and only 導 ア is surjective. Thus ザ 
71is either injective or surjective, then is both injective and surjective, which 
implies that 7 is invertble. Hence 7 is invertible if and only エア is injective if 
and only エア is surjectiVe. 


The next example illustrates the power Of the previous result. Although it is 
possible to prove the result in the example below without using hnear algebra, the 
proof using Hinear algebra is cleaner and easier. 
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3.67 example: 太 e7e es な Po7y77O77727 P se 7 (5Y 寺 7 の) の ) =9 


The Hinear map 
の ゅ (G+ 5 テ z+ の) の )「 


from アア (R) to itself is injective, as you can show. Thus we are tempted to use 3.65 
to show that this map is surjective. However, Example 3.64 shows that the magic 
of 3.63 does not apply to the infinite-dimensional vector space の (R). We will 
get around this problem by restricting attention to the finite-dimensional Vector 
Space の,(R). 

Suppose 9 の (R). There exists a nonnegative integer 77 such that7 の,(R). 
Defne アグ (R) っ の,(R) by 


7p ニ (G+ 5x+7) ヵ ) 


Muliplying a nonzero polynomial by (>+ 5x+ 7) increases the degree by 2, and 
then differentiating twice reduces the degree by 2. Thus 了 is indeed a hnear map 
from アグ ,(R) to itself. 

Every polynomial whose second derivative equals 0 is of the form 7y+ ち 
where 。 ち 6 R. Thus null 了 アテ (0). Hence 了 is injectve. 

Thus 了 is surjective (by 3.65), which means that there exists a polynomial 
と の ,(R) such that ((x^+5x+7)p)” = g, as claimed in the title of this example. 


Exercise 33 in Section 6A gives a similar but more spectacular example of 
using 3.65. 

The hypothesis in the result below that dimV = dim W holds in the important 
special case in which is finite-dimensional and W = Thus in that case, the 
equation 57 = 7implies that 57 = ニア 5, even though we do not have multphcative 
commutativity of arbitrary linear maps from to 


3.68 57 ニ 7 < 7S ニ 7(o7z vec7o7 spgCey 0/ 777e 7776 の 777767757O7) 


Suppose V and MW are fimite-dimensional vector spaces of the same dimension, 
S と Z(W), and ア 7 々 (WW ぴの). Then 57 =7Tifand onlyif7S= 了 7 


Proof First suppose 57 = To と and7? =0,then 
の ニル アニ (5 ず 7) = 65(7 の ) = 5(0) = 0. 


Thus 了 is injective (by 3.15). Because and W have the same dimension, this 
implies that 了 is invertible (by 3.63). 
Now multiply both sides of the equation 57 =7by 7 アー「 on the right, getting 


一 


Thus TS = 77ー ト ニー 了 as desired. 

To prove the implication in the other direction, simply reverse the roles of 5 
and 了 (and and W) in the direction we have already proved, showing that 
TS = ニル then S7 = テア 
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人 バ o777 の 7 の 7c Vec7O7 SpgC@y 


The next definition captures the idea of two vector spaces that are essentially the 
same, except for the names of their elements. 


3.69 definilion: 7 が 5O777O7 の 775774。 75O77707777C 


e An 7 が so77 の 7 の 775777 1S an invertible linear map. 


e Two vector spaces are called 7so7zo7 の 77c if there is an isomorphism from 
one vector space onto the other one. 


Think of an isomorphism 了 7: リー Wasrelabeingo と Vas7oe W. This 
viewpoint explains why two isomorphic Vector spaces have the same vector sDace 
properties. The terms “isomorphism "and “mvertible linear map” mean the same 
thing. Use “1somorphism'" when you want to emphasize that the two spDaces are 
essentially the same. 

It can be dificult to determine whether two mathematical structures (such as 
groups or topological spaces) are essentially the same, differing only in the names 
of the elements of underlying sets. However, the next result shows that we need 
to look at only a single number (the dimension) to determine whether two vector 
SDaceS aTe isSOmorphic. 


3.70 g7777e747O72 577Ory We777e7 ecC7O7 SDC6y 76 75 の 77707 の 777C 


Two finite-dimensional vector spaces over F are isomorphic if and only せ they 
have the same dimension. 


Proof First suppose V and W are isomorphic fimite-dimensional Vector sDaces. 
Thus there exists an isomorphism 7 了 from onto W. Because 7 is invertible, we 
have null7 ニ {0) andrange7 = MW. Thus 


dmnul ザ = テ 0 and dimrangee ア = dim WI 


The formula 
dim ソ = dimnul ア + dimrange 了 7 


(the fundamental theorem of linear maps, which is 3.21) thus becomes the equation 
dimV = dim WW, completing the proof in one direction. 

To prove the other direction, suppose and W are finite-dimensional Vector 
spaces of the same dimension. Let の,…, の , be a basis of V and の 」,…, の, be a 
basis of W. Let 了 ア と ん ( W) be defned by 


(の 」 キー の ) 三 CO の 」 キー オロ の の 


Then 了 is a well-defined Hinear map because の 」, .…,6, 1S a basis of Also, 了 李 
is surjective because の 」,…, の, SDans W. Furthermore, null7 = (0) because 
の …, の , 1S Hinearly independent. Thus 7 is injective. Because 7 is injective and 
SurjectiVe, it is an isomorphism (see 3.63). Hence and MW are isomorphic. 
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The previous result implies that each 
fimite-dimensional vector space V is iSO- 
morphic to FE? where 7 = mV For 
example, 半 77 iS a nonnegative integer, 
then の ,(F) is isomorphic to FT ト 

Recall that the notation F777 denotes 
the vector space Of 7 が -by-7 matrices with 
entries in F. fo」,…, の , 1S a basis of レ 
and の 」,…, の 1S a basis of W, then for 
each 了 と WW), we have a matrix 
77(7) FThus once bases have 
been fixed for V and W, 7 becomes a 
function from /( W) to F の 7 Notice 
that 3.3S and 3.38 show that 7 is a Hm- 
ear map. This linear map is actually an 
isomorphism, as we now show. 
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ve7y 777e- の 77767297 の 77 VeC7 の 7 SC@6 
7 が 5 75 の 77O7 の 77c 7 の yO の 76 FT 777775 7 7 の 7 
7M457 574 の > F" 772576d9 O/ 7777@ ge72@7/ 
VeC/O7 5 の の C6y/ 7 の 729W67 7775 の 7465- 
77 の 7,, 7 の 7e 777 の 7 77 72Ves7gg77 の 77 の 7 F" 
の 7 yOo77 7 7 の の 777e7 VeC/O7 SC6y. 
7o7 erg77 の /6, 6 WO7477 e77CO7477767 777e 
77777 DCe 972 の 7 の 7256 O/ 777267 7 の 
47777og7 egc77 の 7 777eye Vec7O7 ? の の C@9 
75 75 の 777 の 7 の /77c 7 の yoO776 の 7777777g の 7 
77e77 777 の y の 77e77 の 7 co7 の /er7y 
7 7 の 7eW 7757g777. 


3.71 々 (! W) gz F7 の 7 7e 75O77 の 7 の 77c 


SUuDDOSe の ], …, の 1S a basis of and の 」, .… 
an isomorphism between 々 (WV W) and F 守 7 


っ > の, 1S a basis of W. Then 7 is 


Proof 
and surjectiVe. 


We already noted that 7 is linear. We need to prove that 7 is injective 


We begin with injectvity. 7 イズ (WW) and 7) = 0, then 7 = 0 for 
each = 1,.…,7. Because の 」, …, の, 1S a basis of this implies7 = 0. Thus 77 
is injective (by 3.15). 

To prove that 7 is surjective, suppose 4 TFP By the linear map lemma 
(3.4), there exists 7 と 々 (V W) such that 


777 
J ナ ? ヒー 90. 4 の 
7=1 


for eachk = 1,.…,7. Because 7) equals 4, the range of 7 equals FE の ん as 
desired. 


Now we can determine the dimension of the vector space of linear maps from 
one fimite-dimensional vector space to another. 


3.72 dm 々 (WW) = (dim り )(dim W) 


Suppose V and MW are finite-dimensional. Then 々 (WV W) is finite-dimensional 


and 
dim 々 (V W) = (dim )(dim W ). 


Proof The desired result follows from 3.71, 3.70, and 3.40. 
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7777eg7 7 の y 77o7zg77 oO/ 5 47277 77777/7cG77 の 7 


Previously we defined the matrix of a linear map. Now we define the matrix of a 
Vector. 


3.73 gdefinition: 7g77Zr の 7 @ vec7 の 7 7 (の ) 


Supposeo Vando」,…, の , 1S a basis of The 27 婦 の の with respect to 
this basis is the 7-by-1 matrix 


1 
we=| : | 
(2 


where り ,…, ち , are the scalars such that 


の 三 の 1 wss-d 上 の 二 


The matrix 7(?) of a vector の と Vdepends on the basis の 」,…, の 。 Of Vas 
well as on o. However, the basis should be clear from the context and thus it is 


not included in the notation. 


3.74 example: 774777 の げ @ VeC7 の 7 


e The matrix of the polynomial 2 7x+ 5 や + x* with respect to the standard 
basis of の ,(R) is 
2 
ーZ 


0 
5 
1 


e Thematrix of avectoryF" with respect to the standard basis is obtained by 
writing the coordinates of r as the entries in an 7-by-1 matrix. In other words, 


ザ ィ ーー( テ 和 ,…,,) 所 FE then 
イ ュ 
7(>) = ニ : 
の 


Occasionally we want to think of elements of V as relabeled to be 7-by-1 
matrices. Once a basis の 」, .…, の, 1S chosen, the function 7 that takes の と to 
27 (の) is an isomorphism of onto Fthat implements this relabeling. 

Recall that if 4 is an 7-by-7 matrix, then 4. , denotes the “column of 4, 
thought of as an 77-by-1 matrix. In the next result, 7(7?/) is computed with 
respect to the basis の 」, .…, の Of WW. 
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7 が 5) 0 三 27(7?/). 


Suppose 7 々 (V W) and o」,……, の, 1S a basis of V and の 」,.…, の, 1S a basis 
of W. Let 1 < た < ヵ 7. Then the column of 77(7), which is denoted by 
7 ⑦). 。 equals 7 (7?). 


Proof The desired result follows immediately from the definitions of 7 7) and 
27 (7ou). 


The nextresult shows how the notions of the matrix of a linear map, the matrix 
of a Vector, and matrix multiplication fit together. 


3.76  /7eg7 7 の 5 9C7 /7e 7 が 7777777 の 77C77O77 


Suppose 7 三 々 (W) ando と ツ ソ Suppose の 」,.…, の , 1S a basis of and 


の …, の 15 a basis of W. Then 


27(7o) = 7(7)77( の ). 


Proof Supposeo 三 の キー… キ ちの Where り 」,…, ち ,  F. Thus 


7 "72 
3.77 Jo = の 7 の 」 キー キナ 9. 
Hence 


27(7 の ) = 上 77(7o」) キー ナル 7? ) 
守 77⑦). 中 92 直 の 200 は) 。 
= 7⑦).77(④), 


where the frst equality follows from 3.77 and the inearity of 7, the second 
eduality comes from 3.75, and the last equality comes from 3.50. 


Each 77-by- ヵ matrix 4 induces a linear map from F1 to E の 1 namely the 
matrix multiplication function that takesy 三 F"1 to Ar と F の 1 The result above 
can be used to think of every Hinear map (from a finite-dimensional vector space 
to another fimite-dimensional vector space) as a matrix multiplication map after 
suitable relabeling via the isomorphisms given by 7. Specifically, ザ 7 と ん (W) 
and we identifyo と with 77(?)  F” 1 then the result above says that we can 
identify 7? with . ル 7 (7). ル 7(?). 

Because the result above allows us to think (via isomorphisms) of each linear 
map as multiplication on FE"「 by some matrix 4, keep in mind that the specific 
matrix 4 depends not only on the Hinear map but also on the choice of bases. One 
of the themes of many of the most important results in later chapters will be the 
choice of a basis that makes the matrix 4 as simple as possible. 

In this book, we concentrate on linear maps rather than on matrices. However, 
sometimes thinking of linear maps as matrices (or thinking of matrices as linear 
maps) gives important insights that we will find useful. 
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Notice that no bases are in sight in the statement of the nextresult. Although 
27 (7) in the next result depends on a choice of bases of "and MW, the next result 
shows that the column rank of 77(7) is the same for all such choices (because 
range7 does not depend on a choice of basis). 


3.78 の 77e727O72 の 7 range 7 eg/5 co7Z7772 777 た 7 7 ( ア ) 


Suppose and W are finite-dimensional and ア 7 ん (WV). Then dim ranse 了 了 
eduals the column rank of 7 (7). 


Proof Suppose の ],…, の , 1S a basis of V and の, … の 18 a basis of W. The linear 
map that takes oo  W to 7(o) is an isomorphism from WW onto the space F} 
of 娘 -by-1 column Vectors. The restriction of this isomorphism to range 7 [which 
equals span(7o」,…, 7,) by Exercise 10 in Section 3B | is an isomorphism from 
range7 onto span(77(7o),…, 7 (7o)). For each k 6 {1, .…,7)。 the 嫌 -by-1 
matrix 7(7o) equals column た of (7). Thus 


dimrange7 = the column rank of (7), 


as desired. 


C727ge oO/ gy75 
In Section 3C we defned the matrix 
27( 了 7, (の の) (の 1 の) ) 


ofa Hinear map 了 from to a possibly different vector space 【W, where の 」, …, の , 
isabasis of and の 」,…, の, 1S a basis of IW. For Hinear maps from a Vector space 
to itself, we usually use the same basis for both the domain vector space and the 
target vector space. When using a single basis in both capacities, we often write 
the basis only once. In other words,i 導 7 ん ( ぴ ) and の 」,… の 。 1S a basis of 
then the notation 77( 了 7, (の 」,.…, の,) ) is defined by the equation 


27(7, (の っ の) ) 7(7。 (の の), (の ], …, の ) ) 


Tf the basis o」, .…,?, 1S clear from the context, then we can write just 7 (7). 


3.79 definition: 77e777 の 727, 7 


SuppOse 7 1S a DOSitive integer. The 7-by-7 matrix 


村 


with 1's on the diagonal (the entries where the row number equals the column 
number) and 0's elsewhere is called the 77ez77 の 77 and is denoted by 7. 
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In the definition above, the 0 in the lower left corner of the matrix indicates that 
all entries below the diagonal are 0, and the 0 in the upper right corner indicates 
that all entries above the diagonal are 0. 

With respect to each basis of V the matrix of the identity operator 7 と 々 (の ) 
is the identity matrix 7. Note that the symbol 7 is used to denote both the identity 
operator and the identity matrix. The context indicates which meaning of 7 is 
intended. For example, consider the equation 7 (7) = on the left side 7 denotes 
the identity operator, and on the right side 7 denotes the identity matrix. 

Tf 4 is a square matrix (with entries in F, as usual) of the same size as 7, then 
47 = ニ 74 = 4, as you should Verify. 


3.80 definition: ver77 の /e, 7 が yersye, 4ー1 


A square matrix 4 is called zve77 の /e there is a square matrix p of the same 
size such that AB ニニ p4 ニ wecall the ve7ye of 4 and denote it by 2 は 


The same proof as used in 3.60 shows So776 772777e77777CZ2745 7456 777e 7677779 
that if 4 is an invertible square matrix。 os が gr g7 の sgz/g7。 wc7 
then there is a uniqgue matrix suchthat eZ 娘 e sg7e 25 72ve77 め /e 2 の 7 
4 ニ PP4 = ニ 了 (andthus the notation 訪 e7 め /e. 
jp = 4ー) is justified). 

TIf 4 is an invertible matrix, then (CA) デ 三 4 because 


4-14 ニー 44- ト ニー 了 7 


Also, 4 and C are invertble square matrices of the same size, then 4AC is 
invertible and (4C)-! = C-14-+ because 
(4O)(C~4~)) = 4(CC)4 

= 474 ブ 1 

= 4A~+ 

ニ 了 
and similarly (C-!4~))(4C) = 7 

The next result holds because we defined matrix multiplication to make it 


true-see 3.43 and the material preceding it. Now we are just being more explicit 
about the bases involved. 


3.81 77 克 の 7 の 7Od の 7zc7 O/ 777e の 7 7 の? 


Suppose7 生々 (, の ) and 5 と 々 (V W). 7 .…, 15 a basis of の], .…, の , 


is a basis of and の 」, .…, の ⑦。 1S a basis of MW, then 


7(S57!, (4 っ 7), (の ], co 寺 
(5。 (の eo の (9 Re 205U2GI5 (の ocn の (の oc の) 
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The next result deals with the matrix of the identity operator 7 with respect 
to two different bases. Note that the column of 77 (7 (4 ,……, 妨 ), (の の 。) ) 
consists of the scalars needed to write zz as a Hnear combination of the basis 
の ],…。 の 

In the statement of the next result, 7 denotes the identity operator from to 
In the proof, 7 also denotes the 7-by-7 identity matrix. 


3.82 77 の 7 7 の e77777 の De777O7 7777 7e5DeC7 7 の YO yey 


Suppose that 4 ,…, 74, and の ,…, の aTe bases of じ Then the matrices 


4(0L(2。 eo) (の ea)) gm OL の)。( の 00 の) 


are invertible, and each is the inverse of the other. 


Proof In 3.81, replace cp, with , and replace S and ア with 7 getting 
= (7 (6, の) (2 …) 7) 7 (7 (2 …。 7 (の 1 …) 6) ) 
Now interchange the roles of the 7/s and の s, getting 
了 = (7 (2,…) 7), (の …) 6) ) 7 (7 (の 1 …) の (2, …) 7) ) 


These two equations above give the desired result. 


3.83 example: 7 が の 7 77e777 の 72 F< 27 7esDec7 7 の 7 の の yey 


Consider the bases (4,2),(5, 3) and (1.0),(0,1) of F2 Because 7(4,2) = 
4(1,0) + 2(0, 1) and 7(5, 3) = 5(1,0) + 3(0,1), we have 


4 5 
27(7.((④.2).(5.3)).(①.0).(0.1)) ) = ( ら 当 ) 


The inverse of the matrix above is 


3 5 
2 中 の 
0 


as you should verify. Thus 3.82 implies that 


3 
が (r(GOeD(2.6 め ) = [ 2 ) 


| 
Iolm 


Our next result shows how the matrix of 了 changes when we change bases. In 
the nextresult, we have two different bases of each of which is used as a basis for 
the domain space and as a basis for the target space. Recall our shorthand notation 
that allows us to display a basis only once when it is used in both capacities: 


2777, (4)) ニ 7(7, (4, (7, 7) ) 
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3.84  c/7ge-o/- の 575 /27777777 の 


Suppose 7 三 々 ( ぴ ). Suppose 4, .…, 4 and 6, … の arTe bases of Let 


%200(0 2) Sm め 三 400 の の) 
andC= (7 (4,…, 久 ), (の,…, の) ). Then 
4 =C-1BC. 


Proof In 3.81, replace cp, with zz and replace 5 with 7 getting 
3.85 導 紀 TWO (OPD0。 


・ っ ワカ 


where we have used 3.82. 
Again use 3.81, this time replacing の 。 with Also replace 7 with 7 and 
replace S with 了 , getting 


27 (7, (4 」…, 7), (の ],…。 の 。) ) 三 PC. 
Substituting the equation above into 3.85 gives the equation 4 = ニ CBC. 
The proof of the next result is left as an exerctise. 
3.86 7277 の 7 72De7Se 6974 の 7 777De7S6 の 7 777777X 


Suppose that ?」, .……, の , 1S a basis of and ア と 々 ( ゆ ) is invertble. Then 


27(7ー) = (27(⑦))~「, where both matrices are with respect to the basis 
ooo の 9.。 


re7czyey う 


1 Suppose7 と EZVW) is invertible. Show that アー is invertible and 
(ジリ 


2 Suppose7 と (し ) andS5 E ん (WV) are both invertble Hinear maps. 
Prove that 57 と (7, W) is invertible and that (57)-! = アー15-1. 


3 Suppose is finite-dimensional and 了 と 々 (). Prove that the following 
are eduivalent. 
(a) 了 了 is invertible. 
(b) 7?」,.…, 7 is a basis of for every basis の 」, .…,o, Of 
(c) 7 の 」, …, 了 o, 1S a basis of for some basis の 」,…, の, Of 


4 Suppose V is fnite-dimensional and dimV > 1. Prove that the set of 
noninvertible linear maps from V to itself is not a subspace of ( げ ). 


10 


11 


12 


13 


14 


15 


16 
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Suppose V is finite-dimensional, / is a subspace of ! and 5 E 々 (の ). 
Prove that there exists an invertible hinear map 7 from V to itself such that 
7z = 5z for every z U 識 and only if S is injective. 


Suppose that W is finite-dimensional and 5.7 と 々 (WW). Prove that 
null5 ニ null ア i and only ithere exists an invertible E と 々 (W) such that 
5 ニ E7 ア 


Suppose that is jinite-dimensional and 5,7 と (WW). Prove that 
range 5 =range7 iand only if there exists an invertible E 々 () such 
thatS= 了 E. 


Suppose and MW are finite-dimensional and 5.7 と (WW). Prove that 
there exist invertible E」 (げじ) and E。 と 々 (W) such that 5 = 5。7E」 補 
and only 半 dimnull5 = dimnull 77 


Suppose V is finite-dimensional and 了 7 テレ ビー Wisa surjective Hinear map 
of onto W. Prove that there is a subspace Uof Vsuch that 7 1S an 
isomorphism of 7 onto WW. 


万 e7e 7 eg77y 7 が ee 777c7 が Oo7 了 7es77c7e の 7o U. 77 が 5 7 な 万 e 7 が 72c77O7 
ose go772 5 U, wi 太 本 2e7 が 67 の |(2) = 7 767 everyz 古人 


Suppose and MW are finite-dimensional and is asubspace of Let 
と = 分 と ZZ) :Cnul177. 


(&) Show that ど is a subspace of 々 (V W). 
(b) Eind a formula for dim と in terms of dm dim W, and dim OU. 


刀 77 の ee や : ん WW) っ 々 (7 W) の の や ⑦) = W が 27 な o null や? 
W727 fy range 2 


Suppose V is finite-dimensional and 5,7 と 々 ( じ ). Prove that 
57 is inVertible = 呈 5and7 ア are invertible. 


Suppose V is finite-dimensional and 5, 了 7, と 々 () and 57U = 了 Show 
that 7 is invertible and that アー = US. 


Show that the result in Exercise 12 can fail without the hypothesis that is 
finite-dimensional. 


Prove or give a counterexample: TVis a fimite-dimensional Vector spDace 
and KS,7 と 々 () are such that RS57 is surjective, then 5 is injectiVe. 


Suppose 7 (げじ ) ando」,… の 15 aHstin such that 7o」,…, 7 の Spans 
Prove that o」,…, の SDans 


Prove that every linear map from F”1 to FE の 1 is given by a matrix multipli- 
cation. In other words。 prove that ザ 了 7 (FC UE の 1), then there exists an 
7-by-7 matrix 4 such that 7x = 4x for every x FT 


17 


18 
19 


20 


21 


22 


23 


24 
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Suppose V is finite-dimensional and S と 々 (). Defne 4 々 (の (D)) by 
プ (7) = 57 
for 了 々 ( ゆ ). 


(a) Show that dim null プ = (dim じ )(dim null 5). 
(b) Show that dmrange プ = (dim ど )(dim range 5). 


Show that and 々 (F,) are isomorphic vector spDaces. 


Suppose is finite-dimensional and 子 と (の ). Prove that ア has the same 
matrix with respect to every basis of iand only 症 了 is a scalar multiple 
of the identity operator. 


Suppose 7 ア (R). Prove that there exists a polynomial ヵ ア (R) such 
that 

9(<) = (x+ *)P(y) + 2xp(y) + (3) 
forallzER. 


SuDPOSe 7 1S a DOSitiVe integer and 4,。EFforall, た =1.….77. Prove that 

the following are equivalent (note that in both parts below, the number of 

eduations equals the number of variables). 

(a) The trivial soluttion x。 = ニ … = ニャ = Ois the only solution to the 
homogeneous system of equations 


7 
M の で 前 省 の ヒー 0 
た = 1 


7 
2 ヒー 0. 
た =1 


(b) For every c」, .…,c,,  F, there exists a solution to the system of equations 


7 
〉. 人 41 た ニ ロ 
た =1 


| 
い 


7 
の 0 一 
た =1 


Suppose 7 と 々 () and ?」,…, の, 1S a basis of Prove that 
27 (7 (の っ) ) iS invertible < つ is invertible. 


Suppose that 2 , 4 8nd の …, の, are bases of V Let 了 と (げじ) be such 
that 7?, = for each た = 1,.…,77. Prove that 


27( 了 7, (の … の) ) 三 7( (Ga っ) (の …。 の ) ) 


Suppose 4 and pare square matrices of the same size and4p= ニ 7. Prove 
that 4 = 子 
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3 万 7og7/c75 7 の Oo77e7775 の 7 Vec7O7 OPC@y 


7og7/c75 の 7 Vec7o7 Spgcey 


As usual when dealing with more than one vector spDace, all vector sDaces in use 
should be over the same field. 


3.87 definition: 7og7/c7 の ec7 の 7 ゞ PC@y 


Suppose V ,…, し , are Vector SDaceSs OVer F. 


e The p7ogzc7 Mx… メ WV is defned by 
MEIXIM 且 三 (Oi NR WM 
es Addition onx…x is defned by 


人 OZ IO ot の PE 三 WOENOT 2 al の 


e Scalar multiplication on リ x… メ P, is defmed by 


UCB の ルー (0 の に ai の 


3.88 example: p7ogzzc7 の 7 娘 e vec7O7 5 の cey の 。(R ) 7 の R*? 


Elements of Z。(R) x R? are lists of length two, with the first item in the list 
an element of の 。(R ) and the second item in the list an element of R3 

For example, (5 一 6Y+ 4Y^ (3,8,7) ) and ( ャ + 9*?, (2,2, 2) ) are elements of 
2 の 。(R) x R* Their sum is defined by 


(5 一 6ex+ 4y^ (3,8,7)) + (x+ 9y?, (2, 2,2)) 
ニー(5-5x+4x2 + 9x5 (5.10.9)). 
Also, 2(5 一 6x+ 4 (3,8,7)) = (10 - 12* + 8y 々 (6, 16, 14)). 


The next result should be interpreted to mean that the product of vector spDaces 
is a Vector space with the operations of addition and scalar multplication as 
defined by 3.87. 


3.89 7od7/c7 o/ vec7O7 SGC6y 75 の DeC7O7 SDC6 


Suppose MM ,…, are Vector spaces Over F. Then x …x, 1S a vector 
SDaCe OVCT F. 


The proof of the result above is left to thereader. Note that the additive identity 
of x…x ル , is (0,.…,0), where the 0 in the 旧 slot is the additive identity of 尼 . 
The additive inverse of (の 」,…) の) 所 メー メリ, 1S (一 の ,… ーー の )・ 
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3.90 example:R<xR? 子 R? の 7R< x R? 7 75o77oO7 の 7c 7o R? 


Elements of the vector space R^ x R? are lists 


((X1, 2), (Y3, 4 5) ) 


where r」, 5, Ys, 4 5 ビ R. Elements of R? are lists 


(], っ , っ) 4) 5 ) 。 


where r」, っ, 3, 4, 5 ビ R. 

Although elements of Rx R* and R* look similar, they are not the same kind 
of object. Elements of R< x R? are lists of length two (with the frst item itself a 
Hist of length two and the second item a list of length three), and elements of R? 
are lists of length five. Thus R^ x R? does not equal R* 


The Hinear map 77775 75O777O7 の 775777 79 9O 777777 の 7 777 


We so777 77777 ん の 7 77 5 の 76/g/e/- 
775. 5O7776 6 の //e 7 の 7777 の 7 の yy 7727 
is an isomorphism of the vector space RxR'egug/sR5 yi な 07 7eo7j7 た 
R2 x R3 onto the vector sDace R5 Thus Cd co77ec7 の 7 77 CD7476S 77e 
these two vector spaces are isomorphic.al- の 7 の 276C7 の 7 72 7e/gpe777g. 
though they are not equal. 


(1,?2), (3, 4, 5) ) 2 (], っ 5) 4 5 ) 


The next example illustrates the idea that we will use in the proof of 3.92. 


3.91 example: ggsfy の の (R) x R< 
Consider this list of length five of elements of の (R) x R<: 
(1, (0, 0) ), (, (0, 0) ), (9 (0, 0)), (0, (1, 0)), (0, (0, 1) ). 


The list above is linearly independent and it spans の (R) x RS Thus it is a basis 
of (R) x R^ 


3.92  Zg7777e7257O72 の 7 @ /7 の 97/C7 75 777e y77777 の 7 の 777767570779 


Suppose V」,…, , are fimite-dimensional Vector spaces. Then  x…x レル, is 


finite-dimensional and 


dm(x…ーx ル アア) =dm 久 すす …+ dm 


Proof Choose a basis of each . For each basis vector of each 区, consider the 
element of  x…xP, that equals the basis vector in the A び slot and 0 in the other 
slots. The Hist of all such vectors is hnearly independent and spans xー メ ル ェ . 
Thusitisabasis of x…x,. The length of this basis is dim オー+ dm , 
as desired. 
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In the next result, the map T is surjective by the definition of V+…ー+V,. Thus 


し 


the last word in the result below could be changed from “injective" to “invertble* 


3.93 7og7/c75 7 77ec7 y777775 


Suppose that 必 ,…,, are subspaces of Defme a jinear map 
T: 当 xx…x レ っ +…+ ォ V by 


IN( の に の 有三 (の ER の 


Then 叱 +ー+ ィ レア, is a direct sum and only 下 T is injectiVe. 


Proof By 3.15, 1 is injectve if and only if the only way to write 0 as a sum 
の キー の where each or is in 人 , is by taking each o, equal to 0. Thus 1.45 
shows that T is injective fandonlyf 攻 キー…ー+V, is a direct sum, as desired. 


3.94  @ 7777 79 の の 77eC7 S77777 7 72 の O77/y が 777767257 の 725 の 7 の 


Suppose V is fnite-dimensional and の ,…, are subspaces of じ Then 


キー ォ ア , is a direct sum if and only 下 


dm( 罰 キー+ ォ ルル ) = ニ dm キキ …+ dm 


Proof The map 1 in 3.93 is surjective. Thus by the fundamental theorem of 
inear maps (3.21), T is injective if and only 下 


dm( 急 キー+ ォ オア) =dimn( 衝 メー メア ). 


Combining 3.93 and 3.92 now shows that 才 キー+V, is a direct sum if and only 
if 
dim( 久 キー+ オ アア ) = テニ dm 久 すす …+ dm , 


as desired. 


In the special case 77 = 2, an alternative proofthat+isadirect sum 
and only if dim(+ の) = dim + dim ゆ can be obtained by combining 1.46 
and 2.43. 


り o77e777 SC6y 


We begin our approach to quotient spaces by defining the sum of a vector and a 
Subset. 


3.95 notation: o+ 


Supposeo 三 and CV Theno+ is the subset of V defined by 


の ロニ {( の Ti:7 と ロリ). 
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3.96 example: s72 の 7 vec7O7 7  O77e-77767257O747 s7/ の spgce 7 R< 


SuDDOSe 0 (10,20) (17,20) 


={(x2z) ER : RI). 


Hence is the line in R^ through the origin with 
slope 2. Thus 


9 (17,20)+ び 
(17,20)+ 
is the line in R< that contains the point (17, 20) 
and has slope 2. / 10 17 
Because (17,20)+U な pg7g//e/ 


0.20) モ U and (7Z20) (7.200+ は 96425pgee 人 


we see that (17,20) + is obtained by moving 
to the right by 7 units. 


Foro と Pandasubsetof 尼 theseto+ is said to be a 7 が 25727e of 7. 


3.98 example: 772/27ey 


e IfUisthe line in R< defined by = {(y,2x) と R< : x R), then all lines in 
R- with slope 2 are translates of U. See Example 3.96 above for a drawing of 
/ and one of its translates. 


e More generally,if isaline in R^ then the set of all translates of / is the set 
of all lines in R< that are parallel to 7. 


ef ロニ {XX, の 0) と R3 : x, 7 R), then the translates of 7 are the planes in 
R* that are parallel to the xy-plane U. 


e More generally, 省 isaplanein R3 then the set of all translates of is the 
set of all planes in R* that are parallel to / (see, for example, Excrcise 7). 


Suppose 7 is a subspace of Then the zo77e77 spgce V/U is the set of all 


translates of 万. Thus 


ゆり = (o+ : の ビザ). 
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3.100 example: 74 の 77e777 5 の Cy 


e If ロニ (2) ER2 : YR),then RU is the set of all ines in R< that have 
slope 2. 


es IfUisalinein R? containing the origin, then RU is the set of all lines in RR*? 
parallel to /. 


e IfUisaplanein R? containing the origin, then R ツ is the set of all planes in 
R* parallel to U. 


Our next goal is to make V/U into a vector space. 1o do this, we will need the 
next result. 


3.101 wo 7 の 725/27ey O7 @ 57/ の 9 の Ce 7 6977 の / O7 の 757O7777 


Suppose is a subspace of and o, Then 


の 一 の < の ?+ す ロミ TO e+ の n(e+ の 9. 


Proof First suppose の ー の リ /.Hfz と U then 
の +7 三 の 二 (( の ー の )+7) の + リ . 


Thus o+ て C+/. Similarly, の + す て の?+/. Thuso+ す ニテ ニ +U,completing 
the proofthat の 一 のび implies の o+ キリ ロー ニ の + ォ ロロ. 

The equatton の キリ ニ の + Uimplies that (の +) n (の + び ) チ 9. 

Now suppose (o+) (の +) 子 の . Thus there exist 4 such that 


Thusoー の ニー 大 . Hence の 一 の ,showing that (の + す ) ロロ (e+) チ の 
implieso ゥ りー の /, which completes the proof. 


Now we can defime addition and scalar multiplication on り /U. 
3.102 definition: gd777o7 7 scg/47 777777 の 77cg77O7 77 V/ 


Suppose is a subspace of V Then 2777o7z and scg/7 777777 の 77Cg77 の 72 8T 
defined on V/U by 


(〈⑦+) (の + す びび ) ニ (?+ す の )+ び 
ん A+) = (Ap) + 記 


forallo, の VandallAEE. 


As part of the proof of the next result, we will show that the definitions above 
make sense. 
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3.103 の 776777 DCe 7 ゞ の VeC7O7 5 の の C6 


Suppose  iS a subspace of / Then V//, with the operations of addition and 
scalar multiplication as defimned above, is a Vector SDace. 


Proof The potential problem with the defimitions above of addition and scalar 
multiplication on V/U is that the representation of a translate of U is not unidue. 
Specifically,。 suDpose の 」, の っ , の 1 の っ are such that 


の ] キ リー の ゥ オロ and の キリ = ニ の っ すす. 


To show that the definition of addition on ぴ // given above makes sense, we must 
show that の ⑦」 の ]) キ エリ ニ ( の + の っ) エキ 
By 3.101, we have 


の て ー の の and の ーー と /. 


Because is a subspace of and thus is closed under addition, this implies that 
(の 」ー の >) (の 」 一 の >)  U. Thus (の 」 の 」) 一 (の 。 十 の 。) と U. Using 3.101 again, 
we see that 

(o+) キリ ニ ( の 二 o2) 二 人 U, 


as desired. Thus the definition of addition on V/ makes sense. 

Similarly。 suppose ル F. We are still assuming thato の e+ オロ ニテ ニ の ナオ. 
Because Uis a subspace of V and thus is closed under scalar multiplication, we 
have (の 」 一 の ) と U. Thus Ao」 一 Ao。 と /. Hence 3.101 implies that 


Thus the defmnition of scalar multiphcation on り Umakes sense. 

Now that addition and scalar multiplication have been defined on WV/, the 
verification that these operations make V/ / into a Vector space is straightforward 
and is left to the reader. Note that the additive identity of V/Uis0+ す (which 
eduals ) and that the additive inverse of の o+ is (の )+ /. 


The next concept will lead to a computation of the dimension of V//. 
3.104 definition: 974077e777 777 の の , 7 


Suppose / is a subspace of The zo7e77 7 の の 7 ソー の Uis the hnear 


map defined by 


77( の ) ニ の オプ 


for eacho と 


The reader should verify that Zr is indeed a Hnear map. Although zz depends 
on as well as these spaces are left out of the notation because they should be 
clear from the context. 
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3.105 の 7e757O77 の 7 774O776777 の C@ 


Suppose V is finite-dimensional and / is a subspace of じ Then 


dim WV = dim ツ ドー dim /. 


Proof Letzrdenote the quotient map from to V/U. の と theno+ リ =0+ げ 
if and only fo と (by 3.101), which implies that null7 = リプ . The definition of 
Zr implies range 7 = V/U. The fundamental theorem of linear maps (3.21) now 
implies dim ソ = dimU+ dim の which gives the desired result. 


Each hnear map ず on induces a Hinear map 7on V/(null7), which we now 
define. 


3.106 notation: ME 


Suppose7 モ 々 (VW). Dene 7: り (ull7) っ Wby 
(の + null 了 7) = 7?. 


To show that the definition of 7 makes sense SuDpose ヵ 。 の ビリ are such that 
g 填 null イ 7 ニー?+mnull 了 7. By 3.101, we have 一 omnull7. Thus7 ア (2 一 の ) =0. 
Hence 7z = 7o. Thus the definition of 7 indeed makes sense. The routine 
verification that 了 is a linear map from V/ (null 7) to W is left to the reader. 

The next result shows that we can think of 7 as a modifed version of 了 ア with 
a domain that produces a one-to-one map. 


3.107 77/ ypgce 7 7772g6 0 の 7 加 


Suppose 7 々 (VMW). Then 
(8) アア o ア = 了 , where 7r is the quotient map of onto V/(nul17): 


(b) 7 is InjectiVe: 


(c) range アニ range 了 : 


(① W り (null 7) and range 了 are isomorphic Vector SDaceS. 


Proof 
(a) Ifo と then (7o)(?) = 7 ア (Zr( の ) ) モミ 了 (⑦ + null ア ) = 7o, as desired. 


(b) Supposeo と and 7(o + null ア 7) = 0. Then 7o = 0. Thus? null ア 
Hence 3.101 implhes thato+nul ア ザー ニ 0+null 7. This implies that null ア ニテ 
{0+ null ア ). Hence 了 is injective, as desired. 

(c) The definition of shows that range 了 ーーrange 7. 


(① Now (b) and (c) imply that 導 we think of 7as mapping into range 了 , then 了 
is an isomorphism from V/ (null ア 7) onto range 7 


Section 3E Products and Quotients of Vector Spaces 103 


re7c7yey う 万 


1 


10 


Suppose 7 is a function from V to WW. The gs7zp7 of 了 ア is the subset of Vx W 
defined by 
graph of 了 7 = 人 {( の 7o) Ex W io リザ ). 


Prove that 7 is a Hinear map i and only 下 the graph of 了 is a subspace of 
Vx W. 
7o772 の 7 の) 6 472c7o7 アカ 7 7o Wo の sj の ye7 了 の x MW sc7 娘 27 7 
egc77 の \ 7e7e er7575 ergc77y O77e 6/e777e777 (の , の ) 三 了 ア 。 77 oe7 Oo7 の 5 
7 が 777c77O7 5 YY777 75 cg77e の 2 の ove 775 57 の 7. We 2 7o7 yy 
妨げ 777c77 の 745 7 7 が 人 5777 の 7 472767 万 oeve ヵ が we の の eco77e 77772/ 
77e7, 万 ere7C7Se CO の e 7e//77 の ye の 7277owy・ ア 7ove 777 9 472c77O7 子 
ガ o7 7o W g477eg7 7770 の の が の 7 の 2 の が ザ ア が な gy の ygce の Vx WW. 


Suppose that 聞 ,…。, are vector spaces such that xx…ー メ レア, is fnite- 
dimensional. Prove that 必 is finite-dimensional for each = 1,.…, 77. 


Suppose 尼 ,…, し, are vector spaces. Prove that 々 (xx メア W) and 
ズ ( 必 ,W) x …x Z( ル WV) are isomorphic vector spDaces. 


Suppose Wi,.…, WW, are vector spaces. Prove that 々 (WI x … x WM) and 
々 (WT) x … x ん (WM) are isomorphic Vector SDaceS. 


For 77 a positive integer, define V by 
V ア ツー ニ ザ x…x ザ . 
ーーーーー ツ 9 
77 times 


Prove that V7 and (FE ウ ) are isomorphic vector sDaces. 


Suppose that 6, are vectors in and that け , W are subspaces of V such 
that の o+ ロニ ァ + MW.Provethat リ =MW. 


Let 7 = {(x,,Z) と R? : 2x+37+5z =0). Suppose 4 て R3 Prove that 
4isatranslate of ザ and only ithere exists c  R such that 


4 ニ = 人 (2) RY : 2x+37+5z = ニ o). 


(&) Suppose 7 と 々 (V,W) andce WProvethat と りり :7 イ イル = テ g) 5 
either the empty set or is a translate of null 子 | 

(b) Explain why the set of solutions to a system of linear equations such as 
3.27 is either the empty set or is a translate of some subspace of FL 


Prove that a nonempty subset 4 of Visa translate of some subspace of V ぜ 
and only if Ao 二 (1 一 AoAforallgo と 4andallAEE. 


Suppose 人 4 ニ マ + リリ 」and4。 = の + for someoo ビリ and some 
subspaces リィ , > of Prove that the intersection 4」n 4。 is either a 
translate of some subspace of V or is the empty set. 
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11 


12 


13 


14 


15 


16 
17 


18 


19 
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Suppose 人 {(Y,*5,… ) と FT : xx 了 0for only finitely many 盛 . 


(&) Show that Uis a subspace of 
(b) Prove that FU is infinite-dimensional. 


Suppose の ],…, の 6 ビ ソ Let 
4 スニ (AO の 0」 キー オル の | 41 ルル Fand 和 人 」 キオ … オ キル ニテ 1). 


(&) Prove that 4 is a translate of some subspace of 


(b) Prove that is a translate of some subspace of and {の 」,…, の) て お, 
then4Cp. 


(c) Prove that 4 is a translate of some subspace of V of dimension less 
than 77. 


Suppose Uis a subspace of such that "Uis fmite-dimensional. Prove 
that Vis isomorphic to U x (りり). 


Suppose and W are subspaces of ソ and ソ ニーロ @ WW. Suppose の ],…, の 
is abasis of WW. Prove that の 」 し … の キリ Uisa basis of り U. 


Suppose U is a subspace of and o+ …) の オキ び is aa basis of and 
2 … っ 7 1S a basis of . Prove that の …。 の, …) 4, 1S a basis of 


Suppose の と 々 (FE) and ゥ 0. Prove that dim (null の ) = 1. 


Suppose Uis a subspace of such that dim り /U = 1. Prove that there exists 
みく 々 (し ) such that null ゅ = ルリ. 


Suppose that 7 is a subspace of V such that V/U is finite-dimensional. 


(a) Show that if W is a finite-dimensional subspace of ソ and ソ ニー リロ + WW, 
then dm W > dim の 厄 . 

(b) Prove that there exists a finite-dimensional subspace W of Vsuch that 
dimW =dim り and ソ ニー@ WW. 


Suppose 了 7 と イィ (W) and is a subspace of Let 7 denote the quotient 
map from V onto り /. Prove that there exists 5S 々 (WU, W) such that 
了 7=5o ぜ and only ぜ Cmnull ア 7 
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27 の 7 か 


の z4/ 5pgce 7 の の 2/ 7 の 


Linear maps into the scalar field F play a special role in linear algebra, and thus 
they get a special name. 


A /7eg7 7c7 が 77 on V is a Hinear map from V to F. In other words, a Hinear 
functional is an element of /(). 


3.109 example: 7777eg7 72C7O7275 


Define e: R* っ R by の (2Z) ニ 4 ャ ー5y + 2z. Then の is a linear functional 
on R ゝ 


Fix (Cc …) FL Defimne ei: FP っ Eby の (1,…)) 1 キー キイ 
Then gis a Hinear functional on FE" 


Defme ゅ : ア (R) っ Rby 


の (の ) = 3 の (⑤) + 7Z ヵ (4). 
Then gis a Hinear functional on ア (R). 
Defme ゅ : ア (R) っ Rby 


1 
% の =| 7 
for each ヵ モア (R). Then ゅ is a hnear functional on の (R). 
The vector space 々 () also gets a special name and special notation. 
The 247 spgce of denoted by ? is the vector space of all linear functionals 


on V In other words, " = ニン /( ル E). 


3.111 dim" =qdm ソ 


Suppose V is finite-dimensional. Then V is also finite-dimensional and 


dim "= の mV 


Proof By 3.72 we have 


dim "= dim 々 (VF) = (dim )(dim F) = dim ソ 


as desired. 
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Im the following definition, the Hinear map lemma (3.4) implies that each の iS 
well defined. 


3.112 definition: gg/ の gs75 

せ の 」,…, の , 1S a basis of then the gd7 の 57s Of で],… の 1S the Hst の ],…, の , 
of elements of 。 where each の is the Hinear functional on V such that 

1 た ニカ / 

0 補 チア 


の (Cx) 三 | 


3.113 example: 77e の 27 57 の 7 7e 7 の 77 の gy7y の げ FE7 


SuPPOse 7 1S a DOSitiVe integer. For1 </ く 7, defme の , to be the Hinear 
functional on F" that selects the 中 coordinate of a vector in F” Thus 


の (>) ニ 


for each (」, .…,Y,)  F* 
Let e」, .…,e, be the standard basis of FThen 


YK=) 
(ez) 三 
0ー |0 


Thus の ,…, の , 1S the dual basis of the standard basis e, …,e, Of FE" 


The next result shows that the dual basis of a basis of V consists of the linear 
functionals on that give the coeficients for expressing a vector in V as a linear 
combination of the basis vectors. 


3.114 の 27 2y75 g7ves coe 廊 c7e775 /27 /77e7 CO777 の 777777077 


SuDDOSe の ] , …, の, 1S a basis of and の 」, …, の , 1S the dual basis. Then 


りー の (の) の ] 十 … 十 の (の ) の , 


for eacho と と 


Proof SupposeoV Then there exist c」, …,c,  F such that 

3.115 の? 三 C1 の 」 キー の 

7 人 …。, 妃 , then applying の , to both sides of the equation above giVes 
の :(⑦) ニ の ・ 


Substituting the values for c」,…,c, given by the equation above into 3.115 shows 
that の ニ の 1( の ) の 」 キオ … 二 の (の の, 
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The next result shows that the dual basis is indeed a basis of the dual space. 
Thus the terminology “dual basis'” is justified. 


3.116 47 2y75 75 6 gy75 の 7e の 7 の gce 


Suppose V is fimite-dimensional. Then the dual basis of a basis of V is a basis 
of 


Proof Suppose の 」,…, の, 1S a basis of Let の , ……, の , denote the dual basis. 
To show that の 」, …, の , 1S a linearly independent list of elements of suppose 
の … っ 7 F are such that 


3.117 の] キ … 士 の 0. 


Now 
(9 の 1 直 375 下 の の)( の ) 三 人 


for each た = 1,.…,7. Thus 3.117 shows that 24。 ニ ーー ニテ g =0. Hence の ],…, の , 
is hinearly independent. 

Because の 」,…, の , 1S a hnearly independent list in V'whose length equals 
dm ぴ (by 3.111), we can conclude that の 」,…, の , 1S a basis of "(see 2.38). 


In the defmnition below, note that 7isa hnear mapfrom to Wthen ア isa 
linear map from W' to ぴ " 


3.118 definiion: gg7 7 の, 7 


Suppose7 了 と WW). The 227 の of ア is the Hinear map 7 と る (W, の) 


defined for each ゅ W'by 


7( の ) = の o 了 . 


ff7 と ZZ(W) and ge Wthen 7( の ) is defned above to be the composition 
of the hnear maps ゅ and 了 7. Thus 7 の ) is indeed a Hinear map from to F: in 
other words, 7( の ) と ぴ " 

The following two bullet points show that 7 is a hnear map from W' to " 


ef. の ゆー W'then 
7T( の + め ) = (の @+ め co 了 ニ の c 了 + め < ア 了 ニ (の + ア ( め . 
sfAEFand? と Wthen 
7(A@) = (Ag) o 了 = ル ( の o 了 了 ) = A7( の ). 


The prime notation appears with two unrelated meaninges in the next example: 
の"′ denotes the dual of the Hnear map り , and が denotes the derivative ofa 
polynomial p. 
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3.119 example: 7 77 の の の 7 7e の が 7e7777277 の 7 77e47 7 の の 


Defne り : の (R) ー の (R) by Dp = 


es Suppose の is the linear functional on ア (R) defimed by の ⑦⑰) = p(3). Then 
のり (の ) is the hnear functional on ア (R) given by 


(D( の ) の ⑰) = (ゆり )⑦⑰) = の (DP) = の の ) = が ③) 
Thus り ( の ) is the linear functional on ア (R) taking ヵ to 7(3). 


e SupDose の 1iS the Iinear functional on ア (R) defined by の ⑦) = 記 . Then 
のり (の ) is the Hnear functional on ア (R) given by 


(が (⑦))⑦⑰) = (の ⑦s り )⑰) 


=p(1) 一 p(O). 
Thus (の) is the linear functional on の (R) taking pto ヵ (1) 一 7(0). 
In the next result, (a) and (b) imply that the function that takes7to7 isa 


jinear map from 々 ( W) to 々 (WP の). 
In (c) below, note the reversal of order from 57 on the left to ア "5' on the right. 


3.120  g/ge/77C /7 の の @7776y O/ の 77 777 の の 5 


Suppose 7 古 々 (V W). Then 

(⑱) (5+ ず の) = ミダ + ォ ア forall5 モ EZ 々 (WW): 
(b) (47)′ = 47 ア for al ん AE: 

(c) (57) "= ア 5' for all 6 と (WO). 


Proof The proofs of (a) and (b) are left to the reader. 
To prove (c), suppose の と. Then 


(57)( の ) = の c (57) = (の oc5) o ア ニー イ ( の o5) = ニア (5( の ) ) = (5)( の ), 


where the first, third, and fourth equal- 0 

ities above hold because ofthe defini- gd 太 y egg of P' gpd アア 

tion of the dual map, the second equality 刀 oweve7, 67e Ve 76Se7Ve 777e 7O7777O7 

holds because composition of functions 7* ん 7 7 罰 e go が 7 7 pe 7o- 

iS aSsociatiVe, and the last eduality fol- ce ez we s/ の 7eg7 7 が Ps の 7 

lows from the definition of composition. er progrc7 y の gcey 7 Cgp7e7 /. 
The equation above shows that 

(57(@) = (75)(@ の foral ゥ る 

Thus (57) = アア 65" 
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7/ Spgce 7 の 277ge oO7 の zg/ o7 777eg7 7 


Our goal in this subsection is to describe null7" and range ア "in terms of range 了 了 
and null7. To do this, we will need the next definition. 


3.121 definiion: g7777727o ヵ 7 9 


ForU て 攻 the gz 廊 727o7 of U, denoted by 7, is defined by 


7 = ニ {( の と : の (=0forallze). 


3.122 example: e/e77@77 O/ 7 の 77727777747 の 7 


Suppose is the subspace of の (R ) consisting of polynomial multiples of *^ 
Tf の is the linear functional on の (R ) defined by の ⑦⑰) =p(0),then ゅ と 


For てこ 攻 the annihilator 7 is a subset of the dual space ". Thus 9 
depends on the vector space containing /, so a notation such as UY would be 
more precise. However, the containing Vector space will always be clear from the 
context, so we will use the simpler notation 


3.123 example: 娘 e Zzz727 7 4 4 の - の 77267257O747 sy の spgce の 7 R 


Let e], 6 っ,63。64。65 denote the standard basis of R: let の 」, の っ >, の 3, の 4 の 5 
(R?) denote the dual basis of e」, ら ,e。,64,6s. SUDDOSe 


び = span(e], ら ) 三 【(y」, *5,0,0,0)  R? : zz  R). 


We want to show that "= span( の 3, の 4, の 5). 
Recall (see 3.113) that の , is the Hinear functional on R? that selects the 罰 
coordinate: の ,(Y っ, 3。 4> 5) ー アテ: 
First suppose の SDan( の 3, の 4, の 5). Then there exist c。,c。,cs  R such that 


の 三 Cs の 3 寺 呈 の 4 填 Cs の s. Tf (r」, Yo, 0,0, 0)  U, then 
の (」, Y っ , 0,0.0) = (ca の 。 + 4 の 4 十 Cs の 5)(Y], 5, 0,0,0) = 0. 


Thus ゅ と "Hence we have shown that span( の 3, の 4, の 5) に 記 " 

To show the inclusion in the other direction, suppose that の と" Be- 
cause the dual basis is a basis of (R5). there exist c], Co, Cs, C4,Cs  R such that 
の 三 1 の] 十 2 の ぅ 填 Ca の 3 填 C4 の 4 十 Cs の 5. Because e」 Uand の と we have 


0 = の (@」) = (の の の > 十 Ca の 3 4 の 4 填 Cs の 5)(1) 三 ・ 


Similarly, e。 三 and thus c。 = 0. Hence の = ca の 3 4 の 4 十 Cs の 5. Thus 
の span( の 3, の 4, の 5), which shows that 9 て SDan( の 3, の 4, の 5). 
Thus "= span( の 3, の 4, の 5) 
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3.124 7 如 e 7772777/477O7 75 の 7 の DCe 


Suppose て Then "is a subspace of P* 


Proof Note that 0 と (here 0 is the zero linear functional on P) because the 
Zero Hinear functional applied to every Vector in is the zero vector in 
Suppose の , ゆ と "Thus の , ゆ と ツリ and の (7 の) ニ ゅ (7 の) ニ 0for every z E U. 
Ifz と CU, then 
(の + め )(72) = の (42) すめ (2) ニモ 0+0=0. 


Thus ゅ + ゅ と 
Similarly, 7 is closed under scalar multiplication. Thus 1.34 implies that リ 
is a subspace of V" 


The next result shows that dim "is the difference of dim and dim . For 
example, this shows that if is a two-dimensional subspace of R? then UV isa 
three-dimensional subspace of (R5), as in Example 3.123. 

The next result can be proved following the pattern of Bxample 3.123: choose 
abasis 7 ,…, 4 Of U, extend to a bas1s 2] … ッ 7 OF Ve の] の)…> の 
be the dual basis of V? and then show that の っ の, 18 a basis of 77 which 
implies the desired result. You should construct the proof just outiined, even 


though a slicker proof is presented here. 


3.125 の 7e757O77 の 7e 777277777477 の 7 


Suppose V is finite-dimensional and 7 is a subspace of じ Then 


dim /9 = dimY ーー dim /. 


Proof _ Let 々 ( , げ ) be the inclusion map defined by 7(4) = zforeachz  /. 
Thus7 is a Hinear map from ぴ to . The fundamental theorem of linear maps 
(3.21) applied to shows that 


dimranee7+ dimnull7 =dim の " 


However, null7 = リ (as can be seen by thinking about the definitions) and 
dim ぴ ' = dim (by 3.111), so we can rewrite the equation above as 


3.126 dimrangef+ dimU リ = dm 


ff ゥ と ぴ , then の can be extended to a Hinear functional ゅ on (see, for 
example, Exercise 13 in Section 3A). The defnition of が shows that 7( め ゆめ) = の . 
Thus ゅ range? which implies that ranee ア = リゾ". Hence 


dimrangee* =dim ロ =dimU, 


and then 3.126 becomes the equation dim+ dim 7 = dimV as desired. 
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The next result can be a useful tool to show that a subspace is as big as 
possible--see (a) 一 or to show that a subspace is as small as possible 一 see (b). 


3.127 co777o77 /27 7e 77777777727 の 7 7 の 69777 {0) 7 7 娘 e 7o/e 5 の gce 


Suppose V is finite-dimensional and / is a subspace of じ Then 


(@⑱ =(0) 呈 (= 
(DSI NSR0 三 0 


Proof TO prove (a), we have 
=(0) dm の =0 
e つ dim ソ = 中 m ソ 
< うつ リリ = テル 


where the second equivalence follows from 3.123 and the third equivalence follows 
from 2.39. 
Similarly, to prove (b) we have 


7 = 呈 dm の =dmW の 
e っ dimO0 = dimY 
e う dimU=0 
* っ うほ =(0), 


where one direction of the frst equivalence follows from 2.39, the second equiva- 
lence follows from 3.111, and the third equivalence follows from 3.125. 


The proof of (a) in the next result does not use the hypothesis that and W 
are fimite-dimensional. 


3.128 7 娘 e7z// spgce の 7 アア 


Suppose V and W are finite-dimensional and7 と 々 (VMW). Then 


(a) null ア "=(range7)?: 
(b) dimnull ア ”" = dimnull 了 7 + dim W - dm 


Proof 
(a) First suppose の null7. Thus 0 ニア (の る ) = go 李 Hence 


0 =( ゅ oc 了 了 )(⑦) = g(7?) for everyo と 
Thus ge (range7)". This implies that null7" て (range7)" 


To prove the inclusion in the opposite direction, now suppose の (range 了 )" 
Thus (7o) = 0 for every vectoroV Hence0 ニ の oc イ 7 ニー ザ (の ). Im other 
words, の null7?。 which shows that (range 7)7 て null 7 completing the 
proof of (8). 
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(b) We have 
dimnull7" = dim(range 7) り 
三 dim W - dimrange 了 
三 dim W 一 (dim ーー dimnul17) 
= dimnul ア 7+ ォ dim W - dm 


where the first equality comes from (a), the second equality comes from 
3.123, and the third equality comes from the fundamental theorem of linear 
maps (3.21). 


The next result can be useful because sometimes it is easier to verify that 7" 
is injective than to show directly that ア iS surjectiVe. 


3.129 7 sz77ec が ve 75 e977V/e777 7 の 7” 727ec7 が ve 


Suppose V and W are finite-dimensional and7 と 々 (VMW). Then 


7 is surjective < つ 7 iinjective. 


Proof Wehave 
了 と バル W) is surjective < つつ ranee7= ェ MW 
e 必 で て ange7)7 ={0) 
っ nul ア =(0) 
< つ 7 isSinjective, 
where the second equivalence comes from 3.127(a) and the third equivalence 
comes from 3.128(a). 


3.130 7 娘 e7g7ge o7 7 アア 


Suppose V and W are finite-dimensional and7 と 々 (VMW). Then 


(a) dimranse7′ = dimrange 了 : 


(b) range7′"= (null7)『 


Proof 
(a) We have 


dimranee7 =dimW' 一 dmnul イ アイ 
= dim W - dim(range7)! 
= dimrange 了 ,。 


where the first equality comes from 3.21, the second equality comes from 
3.111 and 3.128(a), and the third equality comes from 3.123. 
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(b) First suppose g range 了 . Thus there exists め W'such that ゥ ニア ( の め ). 
To null 了 7, then 


の (の ) = (7( ゆ ) )o = (ゆず )(@) = (To) = (0) = 0. 
Hence g (null7)". This implies that range7" て (null ア 7) 


We will complete the proof by showing that range7" and (null7)" have the 
same dimension. To do this, note that 


dimranse7" = dimrange 了 
= dim ソ ー dimnull 7 
= dim(null7)9. 


where the first equality comes from (a), the second equality comes from 3.21, 
and the third equality comes from 3.123. 


The next result should be compared to 3.129. 


3.131 7 ア 7/ec が ue 75 69777V の 7e777 7 の "yz/776C77Ue 


Suppose V and W are finite-dimensional and7 と 々 (VMW). Then 


7 is injective < つ 7 iS surjectiVe. 


Proof Wehave 
7 is injective < つ null ザ =(0} 
e う (mull7)9 ニ / 
* ラ rangee7" ニア, 


where the second equivalence follows from 3.127(b) and the third equivalence 
follows from 3.130(b). 


727/ の の 27 の 7 777eg7 7 の 


The setting for the next result is the assumption that we have a basis の , .…, の, Of 
along with its dual basis の 」,…, の , Of "We also have a basis の 」,…, の 。 Of WW 
along with its dual basis め 」,…, め , Of WW Thus 7 (7) is computed with respect 
to the bases just mentioned of and W, and 7”) is computed with respect to 
the dual bases just mentioned of W”" and V". Using these bases gives the following 
pretty result. 


3.132 727 の 7 7 な 77 が 5 の の ye 7 7 が の 7 子 


Suppose V and W are finite-dimensional and7 と 々 (VMW). Then 


MO(00U 記 NO000DU6 
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Proof Let4= 7) andC= 7). Suppose 1 <7 く 7 and1 < た < が 7. 
From the definition of 77(7") we have 
T( あ )= 2 必 
7 ニ 1 


The left side of the equation above eduals み 7. Thus applying both sides of the 
eduation above to o, gives 


( ゆ 7 の @) = 2 みのり 


あ 三 江 
ヒー Cr 
We also have 


( め *7 の (の @) = み (7o) 
三 の . v 4 し 了 
3 0 
= 2 4 。 め ( の ) 
ァ =1 


ー だ 
Comparing the last line of the last two sets of equations, we have Cr ニ 4 ん 
ThusC = 4!. mm other words, 27(7") = (77)) , as desired. 


Now we use duahity to give an alternative proof that the columnrank ofa 
matrix equals the row rank of the matrix. This result was previously proved using 
different tools 一 see 3.57. 


3.133 co/z77777 7 の 7 6974 の 75 7 の 7 の 7 ん 


Suppose 4 EE Then the column rank of 4 equals the row rank of 人 4. 


Proof Defne 7: F“1 っ FE の 1 by 7 ァ = 4x. Thus 27(7) = 4, where 77(7) is 
computed with respect to the standard bases ofE…1 and FT Now 
column rank of 4 = column rank of 7 (7) 
= dimrange 了 
= dimrange 7 アア" 
= column rank of 77 7) 
三 column rank of 4「 
三 TOW rank of 4, 
where the second equality comes from 3.78, the third equality comes from 3.130(a), 


the fourth equality comes from 3.78, the fifth equality comes from 3.132, and the 
last equality follows from the definitions of row and column rank. 


See Exercise S in Section 7A for another alternative proof of the result above. 
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re7c7yey うど 


10 


11 


Explain why each linear functional is surjective or is the zero map. 
Give three distinct examples of linear functionals on RU 


Suppose V is finite-dimensional and の witho 了 0. Prove that there 
exists の ぴ ' such that の (の ) = 1. 


Suppose V is finite-dimensional and is a subspace of such that チ ソ 
Prove that there exists の と ぴ such that の (2) = 0foreverygEUbut ゅ チ 0. 


Suppose ア 7 と バ ( W) and の … の 15 a basis of range 7. Hence for each 
っ と いじ there exist unique numbers の (の ),…, の 訪 ( の ) such that 


ナニ の 1 (の) の] 二 … 十 の 訪 ( の ) の 


thus defiming functions の 」,…, の from V to F. Show that each of the func- 
tions の ],…, の 1S a Hnear functional on 


Suppose の ,p ぴ . Prove that null ゥ て nullg and only there exists 
cFsuchthat pj ニ c の . 


Suppose that 尼 ,…, , are vector spaces. Prove that ( x…x リ ) and 
必 x… メ are isomorphic Vector SDaceS. 


Suppose の ], …, の, 15 a basis Of and の 」,…, の ,, 1S the dual basis of V: Define 
TE ソーEPandAiE っ ーーVby 


T(?) = (@1( の ,…。 の (の )) and 人 A(g,…9。) 三 4 の 」… 二 本 の 
Explain why IT and 人 are inverses of each other. 


Suppose 77 1S a Dositive integer. Show that the dual basis of the basis 
1 …。 "Of の (R) 1S の 0, の …) の Where 


0) 
の = ニー ュー 


刀 eze の ezoey ee7yyg7 が ye の 用 W7 放 太 e 42e7s7g7 の が g 7 が 7 77e 0 
ge77vg7 が Ve の 7 人 5 


SUDPOSe 777 1S a DOSitiVe integer. 


(&) Show that 1,*ー5,…,(*ー5)7 is a basis of の (R). 
(b) What is the dual basis of the basis in (a)? 


SuDDOse の ],…, の 1S a basis of and の 」, …, の , 1S the corresponding dual 
basis of V. Suppose ゅ と ザ ' Prove that 


め デ ゆ ( の 1 ) の 1 市 90 中 ゆ ( の の 
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16 


17 
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Suppose 5. す と 々 (V W). 


(a) Prove that (5 + 了 アア) = ニン 5 + ォ オア! 
(b) Prove that (47)′= A7"forallA え EE. 


777s ee7C7ye 5 ん y yo 7 の ve7 が 7 (@) g の 7 (の ) 77 3.720. 


Show that the dual map of the identity operator on is the identity operator 
on ぴ " 


Define7: R う っ RSby 
了 (Y, 2Z) ニ (4 5y + 6Z, 7 8y + 92Z). 


Suppose の i, の > denotes the dual basis of the standard basis of R2 and 
必 , め , の 。 denotes the dual basis of the standard basis of R* 


(&) Describe the linear functionals 7( の ]) and (の >). 
(b) Write 7(@」) and (の 。) as Hinear combinations of ゆ 」, め , の 。. 


Defne 7: の (R) ー の (R) by 
(7 の) (*) = *p(*) が (%) 


for each * ヒモ R. 


(a) Suppose g の (R)' is defined by の ゆ ) = が (4). Describe the linear 
functional 7( の ) on の (R). 
(b) Suppose g の (R)' is defined by の ⑦) = 計 ヵ . Evaluate (7(@ の ))(④?). 


Suppose MW is finite-dimensional and7 (WW). Prove that 
7"= ェ 0 < っ 了 =0. 


Suppose and W are fnite-dimensional and 子 と Z(W). Prove that 了 is 
invertible if and only 7" と る (W? の ) is invertible. 


Suppose " and W are finite-dimensional. Prove that the map that takes 
7 了 イズ VW) to ア 6 々 (WP) is an isomorphism of 々 (WV) onto 
々 (WP). 


SupposeUC ば BExplain why 
U7 ={ の と どり :Cnullg み ). 
Suppose is fimite-dimensional and is a subspace of Show that 
= {の o と り : の の) =0for every の と!). 


Suppose is finite-dimensional and and W are subspaces of 


(&) Provethat WVC 較 andonly ぜ (て CW 
(b) Prove that W" = Di 放 and onlyf=MW. 
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Suppose is finite-dimensional and and W are subspaces of 


(a&) Show that(U+ WV= 四 nW 

(b) Show that(UnW)V = ロ + WT 

Suppose is fimite-dimensional and の 」,…, の (Prove that the follow- 
ing three sets are equal to each other. 

(&) SDan( の 1], …, の ヵ ) 

(b) (Qull g」) n… n (null の)) 

(c) ( ゅ と ぴ : ul の))n…n ロ (mullg,) て null の) 


Suppose V is finite-dimensional and o」,…, の WV Define a Hnear map 
Ti ツーEP byT( の ) = (の (の 1), …, の (6) ). 

(a) Prove that の 」,……,6。 Spans V if and only iT is injectiVe. 

(b) Prove that の 」, .…,。 1S hnearly independent if and only if 1 is surjective. 
Suppose V is fmite-dimensional and の 」,…, の ,, ビ . Defne a linear map 
Ti ソーE7byT⑦) = (の (の ,…, の (の )) . 

(a) Prove that の ],…, の 。 SDans ぴ ' f and only せ T is injective. 

(b) Prove that の ],…, の 18 hnearly independent if and only i1 is surjective. 


Suppose V is finite-dimensional and () is a subspace of Prove that 

() = (o と り : の (の ) = 0 for every の と O) 
Suppose 7 (の Z。(R)) and null7′ = span( の ), where の is the linear 
functional on の 。(R) defined by の ⑦) = p(8). Prove that 

range7 = 人 p ヒ グ 。(R) :p(8) =0). 
Suppose V is finite-dimensional and の 」,…, の 1S a hnearly independent list 
in V. Prove that 
呈 m((ull の g]) n… n (null の) ) = (dim ) 一 7 が. 

Suppose and W are finite-dimensional and 了 7 と (WW). 
(&) Prove thatif ゅ W'andnull7” = span( の ), then range ア ニーnull の. 
(b) Prove thatif め と andrange7" = span( の ), then null 了 アニ =n ロ ull め 


Suppose V is finite-dimensional and の 」,…, の , 1S a basis of PV. Show that 
there exists a basis of whose dual basis 1S の 」, …, の ,・ 


Suppose Uis asubspace of Let7: リ ー ツ bethe inclusion map defmed 

by 7 の ) = Thus7 と る の (PV!). 

(a) Show thatnull ア = ロリ 

(b) Prove that if is finite-dimensional, then rangee7 ニ リ * 

(c) Prove that ifV is finite-dimensional, then 7' is an isomorphism from 
7UO onto 7 


77e 7yo777O7 の 777 72 (C) 75 7 の 7779/ 77 7727 7 2esy 7 の 7 epe79 o77 Co7ce の / 
gy75 772 67777e7 YeC7O7 ゞ CC. 
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The oz の /e gg/ ypgce of V denoted by " is defned to be the dual space 
of V Im other words, "= (の ). DefneA: ヤ っ "by 


(Ao)( の ) = の (④⑦) 
for eacho と andeach の と ゾ " 


(&) Show that Aisalinear map from to " 

(b) Show that 7 と 々 ( ゆ ),then 77oA= ニ Ac7, where 7” = (7)" 

(c) Show that ザ Vis finmite-dimensional, then A is an isomorphism from 
onto "". 


5 の の の se V 7 が 5 万 777e- の 7767497O77. 77e77 7 の "27e 75O77 の 7 の /77C, 7 7 の 777g 
g72 7SO777O7 の 75772 万 77 Vo77O "ge7e7g// の 7eg77ey Cooy776 @ の gs7y の 
77 co77 の 7 77e 7yO77 の 7 の 75777 人 方 oz Vo77o "oey 7 の 7 76977776 の C77O7Ce 
の げ の 4y75 7 の 774y 7 CO7757e7e 777 の 7 7777779/. 


Suppose Uis asubspace of Let 7z: ソー リツ be the usual quotient map. 
Thus ZZ 々 (( ゆ け ), の 「). 
(a) Show that Zis injective. 
(b) Show that range7 = ロリ 
(c) Conclude that 7' is an isomorphism from (V/)' onto 
77e 7yo777O7 の 7777 72 (C) 75 297779/ 7 7727 7 oesy 77O7 epe79 o77 @ Co7ce の / 


457y 777 67777e7 vec7O7 の Ce. 777 7 77e7e 75 7 の の 55777 の 7 の 72 7e7e 77 g77y の / 
eye vec7 の 7 SDC@S g76 777776- の 777767257O720/. 


Chapter 4 SM 
7A777///7/27 人 ) 


This chapter contains material on polynomials that we will use to investigate 
jnear maps from a vector space to itself. Many results in this chapter will already 
be familiar to you from other courses: they are included here for completeness. 

Because this chapter is not about linear algebra, your instructor may go through 
it rapidly. You may not be asked to scrutinize all the proofs. Make sure, however, 
that you at least read and understand the statements of all results in this chapter- 一 
they will be used in 1ater chapters. 

This chapter begins with a brief discussion of algebraic properties of the 
complex numbers. Then we prove that a nonconstant polynomial cannot have 
more Zeros than its degree. We also give a linear-alsgebra-based proof of the 
中 Vision algorithm for polynomials, which is worth reading even i you are already 
familiar with a proof that does not use linear algebra. 

As we will see, the fundamental theorem of algebra leads to a factorization of 
every polynomial into degree-one factors if the scalar field is C or to factors of 
degree at most two the scalar field is R. 


人 99 USUAP BZSJIIV 


oo ん 7777e77 7 70Z0 co7727726g 妨 e 万 77 ye77O77S 7 が 4 の y の cg の 7c の の 7 の 777 の 5. 


⑥ Sheldon Axler 2024 119 
S. Axler, 7zeg7 47gep7g の o7ze 7g77。 Undergraduate Texts in Mathematics, 
https://doi.org/10.1007/978-3-031-41026-0 4 
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Before discussing polynomials with complex or real coeficients, we need to 
learn a bit more about the complex numbers. 


4.1 definition: 7eg/ pg77 Rez, 7777287297y の の 77 Im Z 


Suppose z 三 g 二 7, where 2 and ち are real numbers. 


e The 7eg/ pg77 Of z, denoted by Re z, is defined by Rez = ニム. 
e The 7772g727y 77 Of z, denoted by Hm z, is defined by Imz = 


Thus for every complex number z, we have 


=ーRez+ (Imz)7. 


4.2 definition: co77 の /er co7774876, Z, の oO7747e 77/e, | レ | 


Suppose z 三 C. 
es The co7 の /er co774gg7e Of z 三 で, denoted by 2, is defined by 


有 = ニ Rez 一 (Imz)7. 


e The 2 の so/z7e vg/zze of a complex number z, denoted by |z|, is defined by 


還 = V(Rez2 + (Im2)2. 


4.3 example: 7eg/ 7 77779877797Y の 7 CO7 の /er CO777748 の 76, の の yO/7476 Vg777e 


Supposez = ニ 3+27. Then 


e Rez ニ 3andImz ニ 2: 
e シー ニ 3ー27: 
ezl ニ vV32+22 = 13. 


Identifying a complex number z で with the ordered pair (Rez, Im z) と R< 
identifies C with R2 Note that C is a one-dimensional complex vector SDace, 
but we can also think of C (dentified with R2) as a two-dimensional real vector 
SDaCe. 

The absolute value of each complex number is a nonnegative number. Specif- 
ically, if z と C, then z| equals the distance from the origin in R< to the point 
(Rez, Im z) と R2 

The real and imaginary Darts, com- 
plex conjugate, and absolute value have 
the properties Hsted in the following 
multipart result. 


727 so777 ve7 が の) 7 が 27 Z ニタ が g7 の 7 o77/ 
が 27 の 76 の 7 7477 の 6 た 
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4.4 7 の /e777ey の 7 Co77 の ex 77777 の e7y 


Suppose の , 2 三 C. Then the following equalities and inequalities hold. 


Sum of zandz 
キキ 喧 2INSg。 


difference of z and z 
Z-Z ヶ 三 2(Imz)7. 
product of z and 


zz = レレ た 


additivity and multiplicativity of complex conjugate 
の ター ニ の +Zandzz ニ の Z. 


double complex conjugate 
ラー クィ 


real and imaginary parts are Dounded by |z| 
Rez| < く |z| and |Hmz| S |zl. 


absolute value of the complex conjugate 
図 = kl 

multiplicativity of absolute value 

の z| |w| |. 


triangle inequality 
の + 外 くく | 幼 +. 


Proof Pcept for the last item aboVe, Ceo776777C 72767 の 767277O7 の 7 7777876 777- 
the routine verifications of the 8SSertHions egug/ の r 77e /epg7 が の 7 egc7 syde の 7g 
above are left to the reader. To Verify the gc js 7ess 加 7 の 7 6947 0 77e s 


triangle ineduality, We have の 娘 e /e7g775 の 7 如 e vo O77e7 yes. 


Il の Z に ニ (の 二 Z)( の ゆう) 


ー 0 の 二 2 を の 0Z 二 2 の 
三 le に + に 二 CZ 二 Z 
三 lel7+ IP+ 2Re(< の Z) 
< I++ 2|g2| 


ー Io に + に 本 2|zgl | 


三 (lgl+ 了 |)< 


Taking square roots now gives the desired 


- - See 万 Ye7C7se 2 7 娘 e 7eve7Se 7772876 
inequality lp+z| く | の |+ | 


7769 の 77/)/ 
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グ e7oy の 7 / の 7 の 7777/5 


Recall that a functionp:F ーー Fiscalled a polynomial of degree 7 せ there exist 
20 っ 4 ビ F with 子 0suchthat 


2) = 9 の 6 寺本 42 キー… 二 g の Z7 


forallzF. Apolynomial could have more than one degree if the representation 
of ヵ in the form above were not unique. Our first task is to show that this cannot 
happen. 

The solutions to the equation p(z) = 0 play a crucial role in the study of a 
polynomial ヵ と の (EF). Thus these solutions have a special name. 


Anumber ん Fis called a ze7o (or 7oo7) of a polynomial ヵ アグ (F) if 


性 0 


The next result is the key tool that we will use to show that the degree of a 
polynomial is unique. 


4.6 egc/, ze7 の O7 @ 7 の 777777 CO7765/O72 の 9 7 の の の eg7 を @- の 776 /2C7O7 


SupDOSe 77 1S a Dositive integer andp ア (F) is a polynomial of degree 77. 
Suppose 人 ル 三 F. Then ヵ ( 人 ん ) = 0 and only there exists a polynomial 


7 ア (F) of degree 7 ヵ 一 1 such that 


(と 9 胡 三 拓 と た.97//62) 


for every z と F. 


Proof First suppose (人 ん) = 0. Let 2。,,… の, F be such that 
p(②?) = 65 寺本 2 キー オ の 2 

forallzeF. Then 

4.7 の (Z) = p(?Z) 一 (4) = 4 ー ル ) キ … 二 gg(2 グ ケー ル の ) 


for allz FE. For each た {1, .…,77), the equation 


た 
衝 一 AK ニ (zー 和 ) 2 パー1zkー/ 


了 テ 1 


shows that メール Fequalsz 一 times some polynomial of degree た 一 1. Thus 4.7 
shows that ヵ equals z 一 ルル times some polynomial of degree 77 一 1, as desired. 

To prove the implication in the other direction, now suppose that there is 
a polynomial 7 の (F) such that p(z) = (z 一 和 )(Z) for every z  F. Then 
(4) = (ルー ハ )(A) = 0, as desired. 
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Now we can prove that polynomials do not have too many ZeroS. 


4.8 eg7ee 77 7 の /Zey 7 777057 777 <67Oy 


SupDOSe 77 1S a Dositive integer andp アア (F) is a polynomial of degree 77. 
Thenp has at most 77 Zeros in . 


Proof We will use induction on 娘 . The desired result holds if 7 = 1 because 
if g」 チ 0 then the polynomial 2。 2 has only one zero (which equals 一 2。/g). 
Thus assume that 7 > 1 and the desired result holds for 7 一 1. 

T ヵ has no zeros in F, then the desired result holds and we are done. Thus 
SuDpose has a zero ル F. By 4.6, there is polynomial 7 ア (F) of degsree 
7 一 1 such that 

P(Z) = (一)9(②) 
for every z  F. Our induction hypothesis implies that 7 has at most 77 一 1 Zeros 
in F. The equation above shows that the zeros of ヵ inF are exactly the Zeros of 7 
in F along with ル . Thus ヵ has at most 77 Zeros in . 


The result above implies that the coeficients of a polynomial are uniquely 
determined (because if a polynomial had two different sets of coeficients, then 
subtracting the two representations of the polynomial would give a polynomial 
with some nonzero coefhicients but infinitely many Zeros). In particular, the degree 
of a polynomial is uniquely defined. 


Recal that the degree of the 0 poly- 77,e 0 po の 7 の 777 の 7 75 ec/27eg 7 の ve 
nomial is defined to be 一 co. When geg7ee 一 oo ゞ の 77 erCe/77O7S の 76 7 の 07 


neceSSary。 uSe the expected arithmetic ee 67 vg77O7 が 5 7egsO7G の /e 7es7/75 
with 一 co. For example. 一 oo < 7 and sas deg(7g) = degp+ degg. 
ーoo 十 77 ニーoo for eVery integer 77. 


の 757o7 47go777777 727 277777/5 


T ヵ and s are nonnegative integers, with s 記 0, then there exist nonnegative 
integers 9 and 7 such that 
57 二 了 

and7<s. Think of dividing ヵ by s, getting quotient 7 with remainder 7. Our next 
result gives an analogous result for polynomials. Thus the next result is often 
called the division algorithm for polynomials, although as stated here it is not 
really an algorithm, just a useful result. 

The division algorithm for Polynoml- 7 ん の の 太 e の ys7O7 679o777777 727 の の 
als could be proved without using any gs gs giP 加 g の 7 を 70e7 PO の yo- 


linear algebra. HoweVer, as 1S aDPrODTi- 訪 計 /7y7e7 7e 477//77274/ ガ 人 ん 】24777/274 
ate for a linear algebra textbook,theproof め 太 epo/y7o772/ 5. 


given here uses Iinear algebra technidues 
and makes nice use of a basis of 少 ,(F), which is the (7 + 1)-dimensional Vector 
space of polynomials with coefhcients in F and of degree at most 7. 
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4.9 gr757o72 g7go77777777 /67 の の 7 の 77777/5 


Suppose that p,s 三 (F), with s 子 0. Then there exist unique polynomials 


の 7 三 の (F) such that 


59 十 7 


and deg7 < degs. 


Proof Let ヵ =deg ヵ andlet 娘 =degs.TT ヵ < 娘 ,then take7 = 0and7 ニ ptO 
get the desired equation カ リー s+7with deg7 < deg s. Thus we now assume that 
/ を っ 攻 // 

The Hst 


4.10 ] る リー1 5 z5。 ーー ザ g 


is Hinearly independent in 少 ,(F) because each polynomial in this Hst has a different 
degree. Also, the list 4.10 has lensth ヵ + 1, which equals dim ググ ,(F). Hence 4.10 
is a basis of の,(F) [by 2.38]. 

Because ヵ の ,(F) and 4.10 is a basis of の,(F), there exist unique constants 
0 っ 9 の が ーー FE and 大 F such that 


4.11 りー 寺本 2 キー 寺本 127ー ト 5 キ 娘 28 キー キー ダー の 8 


6 填 942 キ … キ の 127ー ト 本 s(DO 2Z キ … オ 27ー の ). 
ーーーーーーーーーーーーーーーーーーー KO 
| 9 


With rand as defined above, we see that ヵ can be written as カー 5s9 十 了 with 
degr < deg s, as desired. 

The uniqueness of 7,7 ビ ア (EF) satisfying these conditions follows from the 
uniqueness of the constants 20, の の …)9 ヵ ーー ュ Fand の ,… ち 。  F satisfy- 
ing 4.11. 


7c7O77<G77 の 77 O/ /o カ 7 の 777275 ove7 C 


W have been handiing polynomials with 77e 247267777 eo7e772 の 7 7ge の 7 75 
complex coefficients and polynomials exjsrence 7 が eo7ep。77y 7 の Oo7 oey 
with real coefhicients simultaneously, let- 7 gg 7o 6 me7 が 09 7 廊 7ng ze7oy・ 
tingF denote R or で C. Now we will 7 2 の 2 が c 7 gyes 7 が e ze7Os 
see differences between these two cases. erp/jc7y ん 7 po/y7o7772/5 o7 eg7ee 2. 
First we treat polynomials with complex 5$ 訪 が 7 oO7e co7 の jcd7e の め 77777725 
coeficients. Then we will use those re- exZs7/67 po/y72o777G/5 の 7 eg7ee 3 7 4. 
sults to prove corresponding results for が oszc777744725 er7577 の 7 の 7y72O77725 
polynomials with real coeficients. の deg7ee 5 7 の の ove. 
Our proof of the fundamental theorem 

of algebra implicitly uses the result that a continuous real-valued function on a 
closed disk in R< attains a minimum value. A web search can lead you to several 
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other proofs of the fundamental theorem of alsebra. The proof using Liouville's 
theorem is particularly nice if you are comfortable with analytic functions. All 
proofs of the fundamental theorem of algebra need to use some analysis, because 
the result is not true 下 で is replaced, for example, with the set of numbers of the 
formc + 識 where c, are rational numbers. 


4.12 772777e77727 777eO7e777 O/ 67ge/7 の , /7757 Ve757O77 


Every nonconstant polynomial with complex coefhcients has a zero in C. 


Proof De Moivre's theorem, which you can prove using induction on た and the 
addition formulas for cosine and sine, states that if た is a positive integer and 
9 R, then 

(cos9+7sin の )* = cos た 9+7sin た の. 


Suppose の C and た is a positive integer. Using polar coordinates, we know 
that there exist7>0and の ER such that 


7(cos 本 7sin の ) = の . 


De Moivre's theorem implies that 


た 
(7(ces と +7sin 5) ニ の . 
Thus every complex number has a 名 root, a fact that we will soon use. 

SupDose 1S a nonconstant polynomial with complex coefcients and highest- 
order nonzero term c』Z7 Then jp(Z)| oo as | っ oo(because |p(2)|/| っ ll 
as |lz| っ oo). Thus the continuous function z ら P(2)| has a global minimum at 
some pointC と C. To show that p(6) = 0, suppose that p(6) チ 0. 

Defime a new polynomial 7 by 


_ が Z+ の 6) 
9 の 9 ェ ーー 


The function z |?)| has a global minimum valueof1atz=0. Write 


9(2) ニ 1+ 2 キー イオ ga ンタ の 
where た is the smallest positive integer such that the coefhcient of z* is nonzero: 
in other words, 7 了 チ 0. 

Let と で be such that が = ーー There is a constantc > 1 suchthatif 

: (0.1), then 

四 (7)1 < 1+ が + が 1c 

呈 注 =ー 否 ー 6) 

Thus taking # to be 1/(2c) in the inequality above, we have |7()| < 1, which 


contradicts the assumption that the global minimum of z ら 7②)| is 1. This 
contradiction implies that ヵ (?) = 0, showing that ヵ has a Zero, as desired. 


126 Chapter4 Polynomials 


Computers can use clever numerical methods to find good approximations to 
the Zeros of any polynomial, even when exact Zeros cannot be found. For example, 
no one will ever give an exact formula for a zero of the polynomial p defined by 


px) ニダ ター5*ー6 や +17xy2+4 ァ ー7. 


However, a computer can find that the zeros of ヵ are approximately the five 
numbers 一 1.87, 0.74, 0.62, 1.47, 5.51. 

The first version of the fundamental theorem of algebra leads to the following 
factorization result for polynomials with complex coeficients. Note that in this 
factorization, the Zeros of ヵ are the numbers 人 ル 」,…, ん which are the only Values 
of z for which the right side of the equation in the next result equals 0. 


4.13 77772777677777 7776O7e777 O/ 7ge/77, yeCO77 の De77O72 


T ヵ アグ ア (C) is a nonconstant polynomial, then ヵ has a unique factorization 
(except for the order of the factors) of the form 


以 (2 有三 6(2 こ DE2S(C 二 0 開 ) 


where c, 人, …, ル 。 6 で . 


Proof Let ヵ と ア の (C) and let 7 = deg ヵ . We will use induction on 7.TT 娘 ニ 1. 
then the desired factorization exists and is unidue. So assume that 77 > 1 and that 
the desired factorization exists and is unique for all polynomials of degree 77 一 1. 

First we will show that the desired factorization of ヵ exists. By the frst version 
of the fundamental theorem of algebra (4.12), ヵ has a zero 4 と C. By 4.6, there 
is a polynomial 7 of desree 77 一 1 such that 


(Z) = ( 々 ー ル )7(Z) 


forallzc C. Ourinduction hypothesis implies that 7 has the desired factorization, 
which when plugged into the equation above gives the desired factorization of p. 

Now we turn to the question of uniqueness. The number c iS uniquely deter- 
mined as the coeficient of 27 inp. So we only need to show that except for the 


order, there is only one way to choose A」,…。 和 ん. 


(タール)… タ ー4) モー)… タ ー ィ て ) 


for all z と C, then because the left side of the equation above equals 0 when 
z 三 A」, one of the て 's on the right side equals 」. Relabeling, We can assume 
that て 」 = A ル 」. Now iz チ ん 」, we can divide both sides of the equation above by 
ヶ ー ん, getting 

(<ー 45)…ー ル ) ニ (ター の )…( マー イ て ) 


forallz ど Cexcept possibly z = A」. Actually the equation above holds for al 
> C, because otherwise by subtracting the right side from the left side we would 
get a nonzero polynomial that has infinitely many zeros. The equation above and 
our induction hypothesis imply that except for the order, the ル "s are the same as 
the で 's, completing the proof of uniqueness. 
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7c7o77Zg77O77 O7 oy7 の 777275 ove7 


A polynomial with real coeficients may 77。 太 廊 7e の 7e 7722772e7777 7 が eo7e77 
have no real zeros. For example, the poly- 7g/ge の rg 67 R gccoz77 が 5 7 7 が e の 7 が た 


・ の と 
nomial 1 "has no real Zeros. e7C@y の evee7? /7e の 7 7ge の 7 の 77 76g/ 
To obtain a factoriZation theorem over co77p/ex vec/o7 spgces, gs e 7 


R, we will use our factorization theorem see /27e7 Cp7e/S. 
over C. We begin with the next result. 


4.14 po/y7zo77772/5 777 7eg/ coe/7c7e7775 22Ve 74O7276/ <e7O ゞ 777 の 77 ゞ 


Suppose ヵ  (C) is a polynomial with real coeffcients.TACisazero 
of ヵ , then so 1s 人 ん . 


Proof Let 
(②?) = 6 本 2 キー の 2 


where 2o,…。 の, Te Teal numbers. Suppose ん Cisa zero of ヵ . Then 
寺本 ルキ オ … オ =0. 

Take the complex conjugate of both sides of this equation, obtaining 
0 寺本 和え キオ … 二 97 0, 


where we have used basic properties of the complex conjugate (see 4.4). The 
equation above shows that 人 is a zero of . 


We want a factorization theorem for 
polynomials with real coeficients. We 
begin with the following result. 


4.15 放 c7o77<77O77 7 の 7 の 7 の 77C の 77 の 7777/ 


Suppose ち , c  R. Then there is a polynomial factorization of the form 


77777 の の 77 770e 9 の 7 が 7/277777472 772 
co7776C77O72 777 777e 7ey7477 の e/O 


*2 十 rc ニ ( テ メー 和 1)( ァ ー >) 


with AA。 と Randonlyif だ >4c. 


Proof Notice that 


ち ヽ 2 だ 
* デ 二 z 十 c ニ (*+ > ) + (<-ー) 


FrSt SUDDOSe / <4c. Then the right 77e eg77O77 ove 75 77e の gy7y の 7 
side of the equation above is positivefor 7/。 /ec/77ge cg7/e の co7p/e77zg 77e 
every y 三 R. Hence the polynomial zzz. 

*^+ py 二 chas no real zeros and thus 
cannot be factored in the form (*ー A1)(Yー っ) with A」, A。 6 R. 
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Conversely, now suppose が > 4c. Then there is a real number 7 such that 


アニ と 


ィ ーC. From the displayed equation above, we have 


が いる 
*^ 二 pr 二 c ニ (+ > ) ー の 


ニ MM g 
= の e+ テー 
which gives the desired factorization. 


The next result gives a factorization of a polynomial over R. The idea of 
the proof is to use the second version of the fundamental theorem of algebra 
(4.13), which gives a factorization ofas a polynomial with complex coeficients. 
Complex but nonreal zeros of come in pairs: see 4.14. Thus if the factorization 
of ヵ p as an element of ア (C) includes terms of the form ( ャ ー ハ ) with ん a nonreal 
complex number, then (*ー ) is also a term in the factorization. Multiplying 
together these two terms, we get 


(*^- 2(ReA)*+ 1), 


which is a quadratic term of the required form. 

The idea sketched in the paragraph above almost provides a proof of the 
existence Of our desired factorization. However, we need to be careful about 
one point. Suppose ル is a nonreal complex number and (*ー 和 ) is a term in the 
factorization of ヵ as an element of ア (C). We are guaranteed by 4.14 that ( ャ ー) 
also appears as a term in the factorization, but 4.14 does not state that these two 
factors appear the same number of times, as needed to make the idea above work. 
However, the proof works around this point. 

In the next result, either 77 or ん may equal 0. The numbers A」,.…, ん ル ん, are 
precisely the real zeros of ヵ , for these are the only real values of > for which the 
right side of the equation in the next result equals 0. 


4.16 刀 c7o77<g77O77 の 7 6 7 の 7277772/ ove7 


Suppose /  (R) is a nonconstant polynomial. Then ヵ has a unique factor- 
ization (except for the order of the factors) of the form 


*(*) = ニ c(xー 41)…( テ ー 4。)(* デ キィ +e)…(x- すみ + cw), 


where ん … ルル …) の 7 っ CR, with 3 く 4c, for each た 


Proof Hirst we will prove that the desired factorization exists, and after that we 
will prove the uniqueneSsSs. 

Think of ヵ as an element of ア (C). T all (complex) zeros of ヵ are real, then 
we have the desired factorization by 4.13. Thus suppose ヵ has a zero え ん と Cwith 
ん R. By 4.14, A is a zero of . Thus we can write 
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PC*) = バー テー2)9() 
= (デー2(ReA)x+ | 和 AP)9(*) 
for some polynomial 7 と の (C) of desree two less than the degree of ヵ . If we 
can prove that 7 has real coeficients, then using induction on the degree of ヵ 


completes the proof of the existence part of this result. 
To prove that 7 has real coefcients,。 we solve the equation above for 7, getting 


(て) 


0 ラー 


forallyER. The equation above implies that 7(*x) RforallxER. Writing 
9(Y) 三 40 寺本 え キ … 二 本. っ 7ー ろ 
where 7 = degand gn,…, っ ビ C, we thus have 
0 =Img(*) = (Hm) (dm)x+… 二 (Hm っ) 


for all ER. This implies that Im 2。,…, Hmg,_ っ all equal 0 (by 4.8). Thus al 
coefficients of 7 are real, as desired. Hence the desired factorization extsts. 

Now we turn to the question of uniqueness of our factorization. A factor of ヵ 
of the form xy2+ 太 x+cr with < 4c can be uniquely written as (*ーA)(ーA。) 
with 4, と C. Amomenf s thought shows that two different factorizations of り as 
an element of の (R) would lead to two different factorizations of ヵ as an element 
of の (C), contradicting 4.13. 


re7c7yey プ 


1 Suppose の ,z と C. Verify the following equalities and inequalities. 
(a) z+ オ タニ 2Rez 
(b) zz= 2(Imz)7 


(c) 交 =IF 


(d①) の タニ の +Zand?0z ニ の る Z 
(e) タニ 
⑪ |IRezl < | and Imz| < 
(@) 還 = 了 M 
(h) ez| = I| 較 | 
77e 7eyj775 g の ove g7e 77e pg775 の 7 イイ 727 e7e /e77 7 77e 7eg の 6 た 


2 Provethatif oz モ C, then | Ie の | 一 | <|o 一 |. 


77e 77e977 の g の ove 75 Cg//cg 777e 7ee7Se 7777257e 77267747777). 
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Suppose V is a complex vector space and の と V. Defner: ソ っ Rby 
の (の) = Re の (の ) for eacho と Show that 


の (の ) ニ の (の ⑦) 一 7 の (の) 
for all の と 
SuDDOse 77 1S a DOsitiVe integer. Ts the set 
(0}U り D と アグ の (F) : deg ヵ = カカ) 
a subspace of の (F)? 


Is the set 
{0) U 人 の (F) : deg ヵ is even) 


a subspace of の (F)? 


Suppose that 77 and 7 are Dositive integers with 娘 < 7 カ ,。 and suppose 
ん 4 っ ん ルビ F. Prove that there exists a polynomial ヵ と の ) with 
deg カ =7 ァ suchthat 0 = ヵ (A1) = … = が ん) and such that p has no 
other ZeroS. 


Suppose that 77 is a nonnegative integer, 2Z],…。。 ェ 1 8Te distinct elements 
of F, and の の],…, の, 」」 ビ F. Prove that there exists a unique Dolynomial 
ヵ の ,(F) such that 

P(2) 三 の k 
for each ル = 1,.…,77 二 1. 


7775 7es7477 cd77 の e /7OV6g 777O77 745776 7777eg7 97ge/7g. 万 oweve7 が y 7 の 77 の 
7e c/eg7e7 SO7767 /7 の OO/ 777 7456 ゞ SO7776 7/77276g7 の /ge の 7 の . 


Suppose ア (C) has degree 77. Prove that ヵ has 7 distinct Zeros if and 
only 王 ヵ and its derivative / have no zeros in common. 


Prove that every polynomial of odd degree with real coeficients has a real 
ZeTO. 


For ヵ アグ ア (R),defne7p:R っ Rby 


2 定子 3. 
7 の (な ) =1 テー3 
が (3) 放 ァ =3 


for each ye R. Show that 7 ヵ 6 ア (R) for every polynomial ヵ の (R) and 
also show that 了 : の (R) っ ア (R) is a hinear map. 
Suppose ヵ モア (で C). Defne7:C っ Cby 


9(Z) ニ p(Z) の (②). 


Prove that 7 is a polynomial with real coefhcients. 
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12 Suppose 77 is a nonnegative integer and ヵ の,(C) is such that there are 
distinct real numbers Yo, テ 1, っ, With の (Yr)  R for each た = 0,1,.…,77. 
Prove that all coeficients ofp are real. 


13 Suppose ヵ と アア) withp チ 0.Let げ = 人 7:9 と モア で )). 


(&) Show that dim ア (F)// = degp. 
(b) Hind a basis of ア (F)/U. 


14 Suppose ヵ 9 と ア (C) are nonconstant polynomials with no zeros in common. 
Let 77 = degpand ヵ = degg. Use Hinear alsebra as outlined below in (3)-(c) 
to prove that there exist7 ビグ 1(C) ands と の 1(C) such that 


7 の 二 s7 三 1. 
(@) Define7: の アー_1(C) x グー1(C) っ の ュー1(C) by 
了 (7,5) ニ の 二 57. 


Show that the Hinear map is injective. 
(b) Show that the Hinear map 7 in (a) is surjectiVe. 


(c) Use (b) to conclude that there exist 7 三 の _」(C) and s の,_1(C) 
such that 7+sg ニ 1. 
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Chapter 5 SS 
7oe7V47746y 77 万 7ge77VeC7 の 7 


Linear maps from one Vector space to another vector space Were the objects of 
study in Chapter 3. Now we begin our investigation of operators, which are Hinear 
maps from a vector space to itself. Their study constitutes the most important 
part of Hinear algebra. 

To learn about an operator, we might try restricting it to a smaller subspace. 
Asking for that restriction to be an operator will lead us to the notion of invariant 
subspaces. Each one-dimensional invariant subspace arises from a vector that 
the operator maps into a scalar multple of the vector. This path will lead us to 
eigenvectors and eigenvalues. 

We will then prove one of the most important results in Hinear algebra: every 
operator on a finite-dimensional nonzero complex vector space has an eigenvalue. 
This result will allow us to show that for each operator on a fimite-dimensional 
complex vector space, there is a basis of the vector space with respect to which 
the matrix of the operator has at least almost half its entries equal to 0. 


377 の 7775 5777 の 77O77 ゞ / の 7 娘 75 CZ の 7e7 


e F denotes R or C. 
e denotes a Vector sDace OVer F. 


AH OO [91Sod Jl8d-SUeH 


57g7ze の / た eo7g7 の o o/ 7sg (7 770-7250, の p7oX7777776 9775), 75O ん 7 の 72 95 77 の 7 の CC7. 
万 Ye7c7ye 27 77 Sec77o7 う sowy 7 の 777eg7 7ge の 7 の Cg72 の e 74y6g 7 の 7 の 
77e er//7c77 め 77777777 727 77e 7 の o74 の cc7 ye9776727Ce SOW77 の 7 777e 廊 O747 CO た 
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54 7777777 S74 の 5 の の C6y 


万 7ge77D7774ey 


A Hinear map from a vector space to itself is called an o/e77 の 7. 


Suppose 了 々 (). 世 っ 2and ecg// 7 娘 27 ye ge77ed 77e 77O7277O77 
= @…@ ゆ し , 々 ( じ ) 7 egz (の ). 


where each 必 iS a nonzero subspace of WV then to understand the behavior of 
了 we only need to understand the behavior of each Tls here | レ denotes the 
restriction of 了 ア to the smaller domain 多 . Dealing with 7 し should be easier than 
dealing with 了 because is a smaller vector space than 

However, if we intend to apply tools useful in the study of operators (such 
as taking powers), then We have a problem: 7|y may not map VM into itself: im 
other words, 了 | し may not be an operator on 多 . Thus we are led to consider only 
decompositions of of the form above in which 了 7maps each 尼 into itself. Hence 
we now give aname to subspaces of that get mapped into themselves by 7 


definition: 777V277777 7 の DC6 


Suppose 7 々 ( ゆ ). A subspace of Vis called 7 が 7 under 了 7 と 
for every z  . 


Thus / is invariant under 了 ザ ア |, is an operator on /. 


5.3 example: yz/ の spgce 72V77777 772e7 7767e777777O72 の の 67 の 7 の 7 


Suppose that 7 と 々 (の (R)) is defned by 7 = ニア. Then み (R), which is a 
subspace of の (R), is invariant under 7 because 半 ヵ ヒア (R) has degree at most 4, 
then / also has degree at most 4. 


5.4 example: /277- 7 の 77 の 777 74 の 5 の Cy, 77O7 776Cey577/y g/7 の 7 ガ c7e777 


アーズ ( ゆ ), then the following subspaces of V are all invariant under 7 
{0) The subspace {0) is invariant under ア because if {0},thenz =0 
and hence7z= ニ 0E{0}. 
1 The subspace V is invariant under 7 becausefz と then7z と 
null 了 The subspace null 了 is invariant under 7 because if 7 null7, then 
Tr = 0, and hence 77 null ア 7 


range7 了 The subspace range7 is invariant under 7 because i 症 7 range 了 , 
then 7 ranee 了 ア 
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Must an operator 7 々 ( ツ ) have any invariant subspaces other than {0} 
and 7 Later we will see that this question has an afhrmative answer Vis 
finite-dimensional and dim ソ >1(forF ニ で)ordim ソ >2(forF =R): see 
5.19 and Exercise 29 in Section 5B. 

The previous example noted that null7 and range ア are invariant under 7. 
However, these subspaces do not necessarily provide easy answers to the question 
above about the existence of invariant subspaces other than {0} and because 
null 了 7 ア may equal {0) and range 了 may equal (this happens when 了 is invertible). 

We will return later to a deeper study of invariant subspaces. INow we turn to 
an investigation of the simplest possible nontrivial invariant subspaces 一 -inVariant 
subspaces of dimension one. 

Take anyo の と witho チ 0andlet equal the set of all scalar multiples of c: 


= 人 {4o : ん EE) = span( の ). 


Then び is a one-dimensional subspace of (and every one-dimensional subspace 
of is of this form for an appropriate choice of の . Hf / is invariant under an 
operator 了 々 (), then 7? 6 /, and hence there is a scalar 人 FE such that 


了 ? ー AA の . 


Conversely, if 7o = Aofor some ん EEF, then span(?) is a one-dimensional 
subspace of Vinvariant under 7. 

The equation 7o = 4o, which we have just seen is intimately connected with 
one-dimensional invariant subspaces, 1s important enough that the scalars 4 and 
Vectors の satisfying it are giVen special names. 


5.5 definition: e7ge74Vg/7e 


Suppose 7 々 (). Anumber ん と Fis called an ege7vg/ze of 了 if there 
existso の Vsuchthato 邦 0 and 7o = Ao. 


In the definition above, we reduire 77,e or ege7yg7e が 5 7 た Oerym の 7 の 


thato 記 0 because every scalar ル ヒ F 2 た yrg/is7、 77e Oery70 の 76 が 68gg7 


satisfies 了 0 = A0. 7269729 “の OW72 ” 72 7e se7se の 7 C77477C- 
The comments above show that ソ ze 7 7 が sjC 7Ope7 が > 


has a one-dimensional subspace invariant 
under 7 if and only エア has an eigenValue. 


5.6 example: e7ge7z/74e 


Define an operator 7 と (E?) by 
7 了 (x,y,Z) 三 (7 3z,3r + 6y + 9z, 一 6) 


for (x,,z) と F* Then 7(3,1, 1) = (18,6, 6) = 6(3,1,-1). Thus 6 is an 
eigenvalue of 李 . 
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The equivalences in the next result, along with many deep results in Hinear 
algebra, are Valid only in the context of finite-dimensional vector SDaceS. 


5.7 eg777V/e777 CO77777O77S 7 の の e 77 @7ge77D7776 


Suppose V is finite-dimensional, 7 と 々 (), and AE F. Then the following 
are eduivalent. 


(a) ん is an eisenvalue of 李 
(b) 7 ー 47 is not injectiVe. Ae7z77e7 了 三 の (P) が 娘 e 7de777 が か 
(c) アー Uis not surjective O/67 の 7 77yJ の ニッ /27g7oE ソ 


(⑨④ 7 ー Ar is not invertible. 


Proof Conditions (a) and (b) are equivalent because the equation To = Ao 
is equivalent to the equation (7 - AD)o = 0. Conditions (b), (c), and (d) are 
eduivalent by 3.65. 


| 5.8 definitlion: e7ge7vec7O7 


Suppose 7 々 () and え ん Fisaneigenvalue of7. Avector の Vis called 
an e7ee77vec7 の 7 Of 了 corresponding to 人 ル 半 の 邦 0and7o = Ao. 


In other words, a nonzero vectoro is an eigenvector of an operator 
7 了 イズ ( ゆ ) 下 and only 7? is a scalar multiple of o. Because To = Aoifand only 
if 7ーA)o = 0,avector の witho チ 0is an eigenvector of corresponding 
to ん fandonlyifoEnul イ ザーA7). 


5.9 example: @7ge7z/4ey 7 67ge74DeC7 の 7 


Suppose 7  (F^) is defined by 7(< の ,z) = (一 Z, の ). 

(a) First consider the case F = KR. Then 7 is a counterclockwise rotation by 90* 
about the origin in R2 An operator has an eigenvalue if and only if there 
exists a nonzero vector in its domain that gets sent by the operator to a scalar 
multiple of itself. A 90" counterclockwise rotation of a nonzero vector in R< 
cannot equal a scalar multple ofitself. Conclusion: TF =R,then 7 has no 
eigenvalues (and thus has no eigenvectors). 


(b) Now consider the caseF = C. 1o fnd eigenvalues of 了 , we must find the 
scalars ル such that (<o, z) ニニ (zo,Z) has some solution other than の ニ z ニ 0. 
The equation 7( の ,z) ニ ル (の ,Z) is equivalent to the simultaneous equations 


5.10 ーZー ル 0。 の ー ル Z. 


Substituting the value for の given by the second equation into the frst eduation 
g1Ves 
ーz 三 人 ^Z. 
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Now z cannot equal 0 [otherwise 5.10 implies that zo = 0: we are looking for 
solutions to 5.10 such that (の , z) is not the 0 vector |, so the equation above 
leads to the equation 

ー1 = う 
The solutions to this equation are ル =7and ル ニー,. 


You can verify that 7 and 一 7 are eigenvalues of 了 7. Indeed, the eigenvectors 
corresponding to the eigenvalue 7 are the vectors of the form (の , 一 の 7), with 
の Cand 子 0. Furthermore, the eisgenvectors corresponding to the 
eigenvalue 一 7 are the vectors of the form (の , の 7), with の Cando チ 0. 


In the next proof, we again use the equivalence 


ナッ ニ ルル の ee ブー47Dp=0. 


.11 7/7eg7 が か 7 の 6 の e72de777 67g677VeC7O7 ゞ 


Suppose 7 々 (). Then every Hist of eigenvectors of 7 corresponding to 
distinct eigenvalues of 7 is Hinearly independent. 


Proof Suppose the desired result is false. Then there exists a smallest positive 
integer 77 such that there exists a hnearly dependent list の 」, .…, の Of eigenvectors 
of ア corresponding to distinct eigenvalues ん 」, … ん Of 了 ア (note that 7 > 2 because 
an eigenvector is, by definition, nonzero). Thus there exist 2], .…, 4 F, none of 
which are 0 (because of the minimality of 7)。 such that 


1 の キ … 二 の の 。 三 0. 
Apply 7 アー ん, 7 to both sides of the equation above, getting 


gg (ルール) の 」 キー エー ュ (ん ー ル ) う の ュ ミニ 0. 


7 一 1 
Because the eigenvalues A」,.…, 人 。 are distinct, none of the coefcients above 
edual 0. Thus の 」,…, の ,_ ュ 1S a Hinearly dependent list of 7 一 1 eigenvectors of 子 
corresponding to distinct eigenvalues, contradicting the minimality of 太 . This 
contradiction completes the proof. 


The result above leads to a short proof of the result below, which puts an upper 
bound on the number of distinct eigenvalues that an operator can have. 


5.12 ope747O7 CG777707 7Ve 777O7@ 67ge72V/77y 777777 の 777767757 の 72 7 eC7O7 の @C6 


Suppose V is fimite-dimensional. Then each operator on has at most dim 
distinct eigenvalues. 


Proof _ Let アー る 々 ( ゆ ). Suppose A」,…, ん are distinct eigenvalues of 了 . Let 
の っ の be corresponding eigenvectors. Then 3.11 implies that the Hist の 」,… の 
is inearly independent. Thus 7z < dim (see 2.22), as desired. 
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oO77775 4p//7e 7O の /e777O7y 


The main reason that a richer theory exists for operators (which map a Vector 
Space into itself) than for more general linear maps is that operators can be raised 
to powers. In this subsection we define that notion and the concept of applying a 
polynomial to an operator. his concept will be the key tool that we use in the 
next section when we prove that every operator on a nonzero finite-dimensional 
complex vector space has an eigenvalue. 

Tis an operator, then 7 ず makes sense (see 3.7) and is also an operator on 
the same vector space as 7. We usually write 72 instead of 7 アア More generally, 
we have the following definition of 7 沈 


5.13 notation: 7 字 


Suppose 7 と 々 () and 7 is a positive integer. 


* 7 ビン ( ゆ ) is defined by 7 イア = 0 


77 times 


e 7 リ is defined to be the identity operator7on 
e If7 is invertible with inverse 7 アー! then 7ー7  /(P) is defined by 


2 三 (m_UT 


You should verify that エ 了 is an operator, then 
了 7 の ー が 十 れ and (POT ー 了 7 


where 77 and 7 are arbitrary integers i エ 了 is invertible and are nonnegative integers 
人 了 is not inVertible. 

Having defined powers of an operator, we can now define what it means to 
apply a polynomial to an operator. 


5.14 notation: (すず) 


Suppose 7 ん ( じ ) and ヵ モア (F) is a polynomial given by 


777 


?(?Z) = 9 寺本 2 の 2 キー… オ の の Z 


for allzcF. Then ヵ (7) is the operator on defined by 


7) = 207 キ 本 7 キ の 7 フォ ーーg 7 


This is a new use of the symbol ヵ because we are applying ヵ to operators, not 
Just elements ofF. The idea here is that to evaluate ヵ (), we simply replace z with 
7 了 in the expression defining ヵ . Note that the constant term g。 in p(Z) becomes the 
operator go7 (which is a reasonable choice because g。 ニ 02" and thus we should 
replace go with zo7 7, which equals go7). 
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5.15 example: 9 po/ カ 74O7777 DP77ed 7 の 777e 7e777777O77 OD@777 の 7 


Suppose り 々 (の (R) ) is the differentiation operator defined by 7 = g and 
ヵ is the polynomial defined by p(x) = 7ー3x+ 5y< Then p( り ) = 77 3D+ 5 り ^ 
Thus 
⑦( ひ D))9 = 737 + 5 


for every 7 ア (R). 


Tf we fix an operator 7 と 々 (), then the function from アア (F) to 々 ( じ ) given 
by りら p ず ) 1S Hinear, as you should verify. 


Tp ヵ , 7 の (F), then pg ア (F) is the polynomial defined by 


(7)(Z) ニカ (2)9(Z) 


forallzEE. 


The order does not matter in taking products of polynomials of a single 
operator, as shown by (b) in the next result. 


5.17 77 の /7cg77Ve の 7 の /67776y 


Suppose の , 9 三 ア (F) and7 々 (の ). 


7777277777 /7oo が が We7z の 7 の gc7 oO7 


Then 2 6 
の /72O7772/S 5 erD4727e の 74y7728 7e 75- 
(⑱ (79)(7) = が 7 の 9⑦): 77 の ve P7 の Pe677 の 7 oes 7 の 7 7776r 
(b) p7)9(7) = 9(7)p(7). We77e7 妨 e yy777 の o/ 7y Z 7 7 
Proof 
(a) Suppose p(Z) = み グ and (2) = 2 2 forallzEF. Then 
7=0 た =0 
⑦9② = 2 2 9 グ ト 
7= ニ 0 を =0 
Thus 
(7)①) = 〉2 2 gp77 
7=0 た =0 
寺 ( 9 7]( ゞ 7 ) 
7=0 ょ =0 


(b) Using (a) twice, we have p④)7①) = (⑰7)7) = (の )(7) = 7(①⑦)⑦). 
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We observed earlier that 7 と 々 (), then the subspaces null7 and range 了 
are invariant under 了 (see 5.4). Now we show that the null space and the range of 
every Dolynomial of 7 are also invariant under 7 


5.18 7z// の ce 77 747775e の 7 (7 ) g7e 77V277727 7727e7 


Suppose 7 々 ( ゆ ) and ヵ ア (E). Then null ヵ (7) and range ヵ (7) are 
inVariant under 7* 


Proof Suppose z null ヵ (7). Then p(7)z = 0. Thus 
(の,①))(72 め ) = ア 7( の 2(7⑦) = テア (0) = 0. 


Hence 7z nullp ヵ ず ). Thus null 7) 1s invariant under 了 , as desired. 
Suppose z 三 range ヵ (7). Then there existso Vsuchthatg = ニ ヵ (7)o. Thus 


Jx ニア (⑦(①) の ) = の (⑦ の . 


Hence 7z range ヵ (7). Thus range p( ず ) is invariant under 了 , as desired. 


re7c7yey うん 


1 Suppose 了 と 々 (V) and Uis a subspace of 


(a) Prove that if て null77, then 7 is inVariant under 
(b) Prove that 導 range 了 て ロロ , then is invariant under 7 ア * 


2 Suppose that 了 と イズ ( ゆ ) and の ,… , are subspaces of V invariant under 
Prove that ナー ォ ツ アリ isinvariant under 7! 


3 Suppose 7 々 ( ゆ ). Prove that the intersection of every collection of 
subspaces Of V invariant under 7 is invariant under 7 


4 Prove or give a counterexample: is fimite-dimensional and is a sub- 
space of V that is invariant under every operator on then リ =(O) or 
リリ = テア 


S Suppose7 と 々 (R2) is defined by 了 (*,) ニ (一 37, *). Find the eigenvalues 
Of 李 


6 Define 7 と (F2) by 了 (<o,z) = (Z, の). Find all eigenvalues and eigenvec- 
tors of 刀 


7 Define 7 と (FE?) by 7 了 (<」, zo,Z。) = (222, 0,5z。). Find all eigenvalues and 
eigenVectors Of 7 了 . 


8 SupposePE イ ( ゆ ) is such that P デ =p Prove that 半 is an eigenvalue of 
then ル =0or ル =1. 
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10 


11 


12 


13 


14 
15 


16 


17 


18 


19 
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Defne 了 : ア (R) っ ア (R) by 7p ニ が". Find all eigenvalues and eigenvectors 
Of 李 


Define 7 々 (の (R)) by (7 ヵ ) (xy) = xp(x) for all x  R. Find all eigenval- 
ues and eigenvectors of ア . 


Suppose V is fimite-dimensional, 7 と 々 ( ゆ ), and x  F. Prove that there ex- 
ists 9 > 0suchthat 了 アーA7isinvertible forall え AFEsuchthat0<|z 一 利く 6. 


Suppose ソ = ロ @ MW, where / and W are nonzero subspaces of / Define 
Pc 々 ( ゆ ) by P(z +w) ニ zforeachzEUandeachwE W. Hind all 
eigenvalues and eigenvectors of 


Suppose 7 々 (). Suppose 5 々 () is invertible. 


(a) Prove that 7 and 5"75S have the same eigenvalues. 
(b) What is the relationship between the eigenvectors of 7 and the eigenvec- 
tors of 5~75? 


Give an example of an operator on R3 that has no (real) eigenvalues. 


Suppose V is finite-dimensional, 7 と ん (ゆり ), and 4 6 F. Show that is 
an eigenvalue of 了 if and only 導 ん is an eigenvalue of the dual operator 
7 と る (『). 


Suppose の …。 の, 15 a basis of じ and ア 7 と 々 (の). Prove that if ん is an 
eigenValue of 了 了 , then 


AI < ヵ maxfl77⑦), 中 1 < た S カ の ) 


where 7 7) denotes the entry in row ヵ column た ofthe matrix of 了 ア with 
resDect to the basis の 」, .…, の 。. 


See 万 Ye7c7se 79 7 5ec77o7 04 727g の 77e777 の oz o7 | 人 |. 


SupposeF = R, 了 と (の),and ん R. Prove that ル is an eigenvalue of 
if and only ぜ ザル is an eigenvalue of the complexification 7 て . 


See 万 Ye7cC7Se 3 7 Sec77o7 づ 太 727 7 が e の e777777 の 7 の 7 7 に . 


SupposeF =R, 了 と て ( ゆ の ),and え で . Prove that 人 is an eigenvalue of 
the complexification 7 if and only ザル is an eieenvalue of 7 に . 


Show that the forward shift operator 7 と 々 (F や ) defined by 
了 (Z],2,… ) 三 (0,2],2 の っ, … ) 

has no eigenValues. 

Define the backward shift operator 5 と 々 (FY) by 
5(Z], 2 っ , 5, … ) 三 (2 っ ,23, … ) 


(a) Show that every element of F is an eigenvalue of 5. 
(b) Hind all eigenvectors of 5. 
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23 


24 


25 


26 


27 


28 


29 


30 


31 
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33 
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Suppose 7 と 々 ( ぴ ) is invertible. 

(&) Suppose え ん と Fwith ル ん 0.Prove that Ais an eigenvalue of 了 隊 and 
only ュ is an eigenvalue of 7ー ト . 

(b) Prove that 7 and 7ー「 have the same eigenvectors. 


Suppose 7 と 々 () and there exist nonzero vectors 7 and oin げ such that 
7 = ニ 3 の and 7 の =34. 
Prove that 3 or 3is an eigenvalue of 7 ア 


Suppose is finite-dimensional and 5,7 と 々 (). Prove that 57 and 75 
have the same eigenvalues. 


Suppose 4 is an 7-by-7 matrix with entries in F. Defne 7 ー 々 (E") by 
7 了 ィ = 4, where elements of F" are thought of as 7 ヵ -by-1 column Vectors. 


(&) Suppose the sum of the entries in each row of 4 equals 1. Prove that 1 
is an eigenvalue of 李 . 

(b) Suppose the sum of the entries in each column of 4 equals 1. Prove that 
1 is an eisenvalue of 了 . 


Suppose 7 と 々 (V) and ヵ 。 の are eigenvectors of such that g+ の 1S also 
an eigenvector of 了 ア . Prove that 7 and are eigenvectors of 7 corresponding 
to the same eigenvalue. 


Suppose 了 々 () is such that every nonzero vector in V is an eieenvector 
of 7. Prove that ア is a scalar multiple of the identity operator. 


Suppose that is finite-dimensional and た 代 ,.…,dim V 一 1}. Suppose 
7 々 () is such that every subspace of V of dimension is invariant 
under 了 . Prove that 7 is a scalar multiple of the identity operator. 


Suppose V is finite-dimensional and 了 と 々 ( ゆ ). Prove that 了 has at most 
1 + dimrange 了 distinct eigenvalues. 


Suppose 7 了  (R3) and 一 4, 5, and V7 are eigenvalues of 7. Prove that 
there exists r  R3 such that*ー9y = (一 4,5, V7). 


Suppose 了 と イズ (V) and ブー2D)7ー3 の 7 ー 9) = 0. Suppose 4 is an 
eigenvalue of 了 ア . Provethat ル = ニ 2or ル =3or ル =4. 


Give an example of7 と 々 (R2) such that 7 キ = ー/. 
Suppose 7 と 々 () has no eigenvalues and74 ニ 7 Prove that 7 テ ニー). 


Suppose 7 と 々 () and 77 is a positive integer. 


(&) Prove that 7 is injective if and only iT" is injective. 
(b) Prove that ア is surjective 下 and only エア 1S surjective. 
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Suppose V is fimite-dimensional and o」,…, の 。 Prove that the Hist 
の … っ の 。 1S hinearly independent if and only if there exists 7 々 ( じ ) such 
that の 」, …, の 。 re eigenvectors Of 了 corresponding to distinct eigenvalues. 


Suppose that ん, …, ん 。 is a Hist of distinct real numbers. Prove that the 
list eY…e 人 xr js linearly independent in the vector space of real-valued 
functions on R. 

刀 7 な ef V = span(e4Y、…… gr) gz de 罰 7e 7 Ope7g7o7 D  (P) 

リ り / = ア 77 ezge7z7zey 74 e7ge77ec7 の 7y の / ワ . 


Suppose that ん,…, ん , is a Hst of distinct positive numbers. Prove that 
the Hist cos(A」*), .…, cos(A。) 1S hnearly independent in the vector space of 
real-valued functions on R. 


Suppose V is fimite-dimensional and7 と 々 ゆ ). Define プ と 々 (Z ゆ )) by 
プ (5) = 了 S 


for each 5 と 々 (). Prove that the set of eisenvalues of 7 equals the set of 
eigenvalues of グ . 


Suppose V is finite-dimensional, 7 と 々 ( ゆ ), and is a subspace of 
invariant under 7. The zzo77e77 Ope7g7 の 7 7/ 7 ん (のり け ) is defined by 


(7/ け )(@6 すけ ) ニモ イ T ッ + 


for eacho と 


(a) Show that the definition of 7/U makes sense (which requires using the 
condition that is invariant under 7) and show that 77 is an operator 
on V//. 

(b) Show that each eigenvalue of 了 /U is an eigenvalue of 7 


Suppose V is finite-dimensional and 了 と イズ (V). Prove that 了 has an eigen- 
Value if and only there exists a subspace of of dimension dim ソ ピー1 that 
is invariant under 7 了 * 


Suppose 5, 了 と () and 5 is invertible. Suppose ヵ と の (F) is a polynomial. 
Prove that 

9900 SM(TOO SS 
Suppose 7 と 々 () and Uis a subspace of invariant under 7 Prove that 
U/ is invariant under ヵ ( ず ) for every polynomial ヵ の (F). 
Defne7 と (FE) by 7(], Yo, テ 3 …,。) 三 (Y],275, 3 …。 7 ) 
(a) Find all eisgenvalues and eigenvectors of 李 . 


(b) Hind all subspaces of F" that are invariant under 7 


Suppose that is finite-dimensional, dim V > 1,and 了 7 ん (げじ). Prove that 
(p①) :p ど ア F)} チ 々 ( り ). 
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う p 77e 777777g7 oo777g/ 


万 Y7y7e72Ce O/ 万 7ge77V7774es O77 CO77 の /er Vec7o7 SD の Cey 


Now we come to one of the central results about operators on finite-dimensional 
complex Vector SDaceS. 


5.19 ex/s/e7zCe O/ e7ge74V7746y 


Every operator on a finite-dimensional nonzero complex vector space has an 
eigenvalue. 


Proof Suppose V is a fimite-dimensional complex vector space of dimension 
ヵ > 0and ア TE バ (). Chooseo と witho 了 0. Then 


の ,7o.72o, …,7 7 の 


is not linearly independent, because V has dimension 7 and this list has lensth 
7 1. Hence some linear combination (with not all the coefcients equal to 0) 
of the Vectors above equals 0. Thus there exists a nonconstant polynomial ヵ of 
smallest degree such that 

ヵ ( ず )o = 0. 


By the first version of the fundamental theorem of algebra (see 4.12), there 
exists ル  C such that ヵ ( ん ) = 0. Hence there exists a polynomial 7 と の (C) such 
that 

p(Z) = ( 々 ー 4)7(②) 


for every > と C (see 4.6). This implies (using 5.17) that 
0 =p7) の = ザー247)(9⑦)?)- 


Because 7 has smaller degree than p, we know that 77⑦)o チ 0. Thus the equation 
above implies that ん is an eigenvalue of 7 with eigenvector 7(7) の . 


The proof above makes crucial use of the fundamental theorem of algebra. 
The comment following Exercise 16 helps explain why the fundamental theorem 
of algebra is so tightly connected to the result above. 

The hypothesis in the result above thatF = で Ccannot be replaced with the 
hypothesis thatF = R, as shown by Example 5.9. The next example shows that 
the finite-dimensional hypothesis in the result above also cannot be deleted. 


5.20 example: 74 Pe7 の 7O7 の 77 9 CO77//er DeC7 の 7 5 の の Ce 7777 74 の 67ge72Vg7776 ゞ 


Defne 7 と 々 (の (で C)) by (7 の) (>) = ZZ). ヵ と の (で C) is a nonzero poly- 
nomial, then the degree of 7 is one more than the desree of ヵ , and thus 7 cannot 
edual a scalar multiple ofp. Hence 了 has no eigenvalues. 

Because ア (C) is infinite-dimensional, this example does not contradict the 
result above. 
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7ge7v77es 7 777e /77777777 Po7777/ 


In this subsection we introduce an important polynomial associated with each 
operator. We begin with the following definition. 


5.21 definilion: zo77c 9 の 2 の 7777 の 7 


A の 77C の の 7 の 77797 1S a Dolynomial whose hishest-degsree coefcient equals 1. 


For example, the polynomial2+ 9z デ +z7 is amonic polynomial of degree 7. 


5.22 eX757e77Ce, 777779746776Sy, の 72 の eg7ee O/ 772772777277 の 77 の 7777g/ 


Suppose V is finite-dimensional and 7 々 (). Then there is a unique monic 


polynomial ヵ の (F) of smallest degree such that p(7) = 0. Furthermore, 
deg ヵ < dm ソソ 


Proof dim ソ =0, then 7 is the zero operator on "and thus we take ヵ to be 
the constant polynomial 1. 

Now use induction on dimV Thus assume that dim V > 0 and that the desired 
result is true for all operators on all complex vector spaces of smaller dimension. 
Leto と Vbesuchthato 子 0. The list o,7o,…,79mVo has lensth 1 + dim ソ 
and thus is hnearly dependent. By the linear dependence lemma (2.19), there is 
a smallest positive integer 77 < dim V such that 77o is a Hinear combination of 
の 。 7 の 。.… 7 ダー1 の . Thus there exist scalars co: Co っ 1 such that 
5.23 co の o+7 の キー オキ Ca 17 7 の ー1o+ ア 7o 0. 

Define a monic polynomial 7 の ,(F) by 
9(2?) ニ Co ロロ 2Z キ オー オキ Ca_127ー ト エ Z 
Then 5.23 implies that 7⑦)o =0. 
Tf た is a nonnegative integer, then 
7)(7*o) = 7T(9(7o) = TO) = 0. 
The Hinear dependence lemma (2.19) shows that o, 7o, ……77ー1o js linearly inde- 
pendent. Thus the equation above implies that dimnull 7(7) > 7 嫌 . Hence 
dmrange97) = dim リ ーdmnull477) < dim ソ リー 万 . 


Because ranee 7(7) 1s invariant under (by 5.18), we can apply our induction 
hypothesis to the operator 7|。。。。。(7) On the Vector space rangeg( ず ). Thus there 
is a monic polynomial s ア (F) with 


degs<dim ソ ツー and sm の) 0. 
Hence for allo と we have 
(s7)(7)( の ) = s ず )(9( ず )) = 0 


because 7①⑦)o range7(7) and 5(7) う La の) 5(7 La。/7)) 0. Thus sis a 
monic polynomial such that deg sg < dim ソ and (s9)7) = 0. 
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The parasraph above shows that there is a monic polynomial of degree at 
most dim that when applied to 7 gives the 0 operator. Thus there is a monic 
polynomial of smallest degree with this property, completing the existence part 
of this result. 

Let ヵ ア (E) be a monic polynomial of smallest desree such that p ず ) = 0. 
To prove the uniqueness part of the result, suppose 7 の (F) is a monic poly- 
nomial of the same degree as and77) = 0. Then ゆー カ (7) = 0 and also 
deg(⑰ー7) < deg ヵ . 革 り ーr ァ were not edual to 0, then we could divide カ ーrby 
the coeficient of the highest-order term in リーrto get a monic polynomial (of 
smaller desree than p) that when applied to 7 gives the 0 operator. Thus ヵ ー ァ = 0, 
as desired. 


The previous result justifies the following definition. 


5.24 definition: 777777727 の の の 77 の 7777/ 


Suppose is finite-dimensional and7 と 々 ( ゆ ). Then the 777247 PO/y7 の 777/ 
of ア s the unique monic polynomial ヵ の (F) of smallest degree such that 
P7) =0. 


To compute the minimal polynomial of an operator 7 々 (), we need to 
jind the smallest positive integer 77 such that the equation 


Co ロナ 十 … 十 1 三 三 紀 6 


has a solution cn, F. wepick a basis of and replace 了 in the 
equation above with the matrix of 了 , then the equation above can be thought of 
as a syStem of (dim P)^ linear equations in the 77 unknowns cp, っ 1 ュ FE. 
Gaussian elimination or another fast method of solving systems of linear equations 
can tell us whether a solution exists, testing successiVe Values 77 三 1,2,.…. until 
a solution exists. By 5.22, a solution exists for some smallest positive integer 
77 < dimV The minimal polynomial of ア is then co 2Z キ オー オキ Cg_127ー ト エ z 欠 
Even faster (usually), picko と リザ and consider the equation 


5.25 の ロロ T ウ キー ナ Camy-17 PPmーo ニーTTmYo。 


Use a basis of to convert the equation above to a system of dimV Hnear edua- 
tions in im unknowns Co, ,…, aim this system of equations has a 
unique solution co, CT,… っ Cam 1 (8S happens most of the time ), then the scalars 
co:C… っ Camyー 1 are the coeficients of the minimal polynomial of 了 (because 
5.22 states that the degree of the minimal polynomial is at most dim の). 

Consider operators on R+ (thought 
of as 4-by-4 matrices with respect to the 
standard basis), and take o = (1,0,0,0) 
in the paragraph above. The faster method described above works on over 99.896 
of the 4-by-4 matrices with integer entries in the interval [一 10, 10] and on over 
99.9999 of the 4-by-4 matrices with integer entries in [一 100, 100]. 


777eye es77772976 ゞ 76 756 O77 76S7777g 
777777O775 の 727 の 0772 7777777C6S. 
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The next example illustrates the faster procedure discussed above. 


5.26 example: 77772727 DO/y72O77727 の 7 の 72 の De77 の 7 77 FE” 


Suppose 7 と 々 (E?) and 


0 0 0 0 -3 
1 0 0 0 6 
77⑦7)= ニ | 0 1 0 0 0 
0 0 1 0 0 
0 0 0 1 0 


with respect to the standard basis e」,e。, es,64,e6s. Taking o = e」 for 5.25, we have 


2 選 WGP6。 且 あ 。 TPe」 = 7(72e」 ) = 7e。 = ー3e」 + 6@。. 
Thus 3e」 一 67e」 = -7?e. The list e],7e」, 72e」 76」 7 う e」, which equals the list 


1, >, 6s, 64, 65, 1S Hinearly independent, so no other linear combination of this Hst 
eduals 7?e」. Hence the minimal polynomial of 了 Tis3 一 6z+z". 


Recall that by definition, eigenvalues of operators on and zeros of polyno- 
mials in ア (F) must be elements of F. In particular, ifF = R, then eigenvalues 
and zeros must be real numbers. 


5.27  e7ge7zvg/7zes 7e 777e Ze7 の y / 777e 777777777797 の /y72777707 


Suppose V is finite-dimensional and 了 と 々 (). 
(a) The zeros of the minimal polynomial of 7 are the eigenvalues of 7. 


(b) is a complex vector space, then the minimal polynomial of ア has the 
form 


(Z po A」)…(< は 2 


where 和 A, …, ん ル , 1S a Hst of all eigenvalues of 7, possibly with repetitions. 


Proof Let ヵ be the minimal polynomial of 了 ア 


(&) First suppose 人 Fisazero of ヵ . Then ヵ can be written in the form 
P(Z) = 々 ー 人 )9(②), 


where 7 1S a monic polynomial with coeficients in F (see 4.6). Because 
り ( ず ) = 0, we have 
0=⑦ー ん 47)(2(⑦o) 


forallo と V Because the degree of 4 is less than the degree of the minimal 
polynomial , there exists at least one vector の Vsuch that7(7)o チ 0. The 
equation above thus implies that ん is an eigenvalue of 了 , as desired. 
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To prove that every egenvalue of 了 is a zero of p, now suppose ルル Fis 
an eigenvalue of 了 . Thus there exists の witho チ 0suchthat 7o = Ao. 
Repeated applications ofto both sides of this equation show that 7*o = Ao 
for every nonnegative integer た . Thus 


り ( ず )o ニカ (人 ん) の. 


Because is the minimal polynomial of 了 , we have p(7)o = 0. Hence the 
equation above implies that p( ん ) = 0. Thus ル ん is a zero of ヵ , as desired. 


(b 


ヽ ュ ン 


To get the desired result, use (a) and the second version of the fundamental 
theorem of algebra (see 4.13). 


Anonzero polynomial has at most as many distinct zeros as its degree (see 4.8). 
Thus (a) of the previous result, along with the result that the minimal polynomial 
of an operator on has degree at most dim V gives an alternative proof of 5.12, 
which states that an operator on V has at most dim V distinct eigenvalues. 

Every monic polynomial is the minimal polynomial of some operator, as 
shown by Bxercise 16, which generalizes Example 5.26. Thus 5.27(a) shows that 
finding exact expressions for the eigenvalues of an operator is eduivalent to the 
problem of finding exact expressions for the zeros of a polynomial (and thus is 
not poSsible for some operators). 


5.28 example: 47 oe7 の 7 の 7 77Oye @7ge77D の zey C9777707 の e 7 の 7 の ergc7 が y 


Let 7 と (で ?) be the operator defined by 
了 (Z」, 2 っ 。 3 る 4 ッ Z5 ) ヒー (一 3z5, る 1 十 625, 2 っ 。 3 Z4). 


The matrix of7 with respect to the standard basis of C? is the 5-by-5 matrix in 
Example 5.26. As we showed in that example, the minimal polynomial of 了 is 
the polynomial 

3 一 6z+ 2*. 


No zero of the polynomial above can be expressed using rational numbers, 
roots of rational numbers, and the usual rules of arithmetic (a proof of this would 
take us considerably beyond linear algebra). Because the zeros of the polynomial 
above are the eigenvalues of [by 5.27(a)], we cannot find an exact expression 
for any eigenvalue of 了 in any familiar form. 

Numeric techniques, which we will not discuss here, show that the zeros of the 
polynomial above, and thus the eigenvalues of 了 , are approximately the following 
five complex numbers: 


ー1.67, 0.51。 1.40, -0.12+ 1.597。 0.12 - 1.597. 


Note that the two nonreal zeros of this polynomial are complex conjugates of 
each other, as we expect for a polynomial with real coefcients (see 4.14). 
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The next result completely characterizes the polynomials that when applied to 
an operator give the 0 operator. 


5.29 7) =0 < 思 97596po/72O7772/ 772777 の /e O/ 77e 7777277277 の の の 777777/ 


Suppose V is finite-dimensional, 7 々 ( り ), and 7 と の (F). Then 7⑦) = 0 
if and only 7is a polynomial multple of the minimal polynomial of ア 


Proof Let ヵ denote the minimal polynomial of 7 
First suppose 9(7) = 0. By the division algorithm for polynomials (4.9), there 
exist polynomials s,7 の (F) such that 


5.30 7 三 5 十 7 
and deg7 < deg ヵ . We have 
0=⑦) = ニ p(7)5 ず ) + す 7) ニ 7(⑦). 


The equation above implies that 7 = (otherwise, dividing 7 by its highest-degree 
coeffcient would produce a monic polynomial that when applied to 7 gives 0: 
this polynomial would have a smaller desree than the minimal polynomial, which 
would be a contradiction). Thus 5.30 becomes the equation 9 ニ /5. Hence 7 1S a 
polynomial multiple of ヵ , as desired. 

To prove the other direction, now suppose 7 1S a polynomial multiple of ヵ . 
Thus there exists a polynomial s ア (F) such that 7 = ps. We have 


7) = が 7)87) =05⑦) =0, 
as desired. 
The next result is a nice conseduence of the result above. 
5.31 777277727 の O カ 7207777 の 7 O/ の 765777C77O72 の の 67 の 7 の 7 


Suppose V is fimite-dimensional, 7 々 (), and is a subspace of that is 


invariant under 7. Then the minimal polynomial of ア is a polynomial multiple 
of the minimal polynomial of 7 


Proof Supposeis the minimal polynomial of 7 Thus 7)o =0forallo と ば 
In particular, 
(7) =0forallz と U/. 


Thus p ヵ 7) = 0. Now 5.29, applied to the operator | in place of 了 李 , implies 
that ヵ is a polynomial multple of the minimal polynomial of 可 . 


See Exercise 23 for a result about quotient operators that is analogous to the 
result above. 

The next result shows that the constant term of the minimal polynomial of an 
operator determines whether the operator is invertible. 
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5.32 7o7 ue777 の /e < つ co7257777 767777 O/ 77772777797 の の が 72 の 7777 の 7 了 ア 7y 0 


Suppose V is fimite-dimensional and7 と 々 ( じ ). Then 7 is not invertible if 
and only ithe constant term of the minimal polynomial of 了 is 0. 


Proof Suppose 了 と 々 () and ヵ is the minimal polynomial of ア . Then 


7 is not invertible < っ 0isan eigenvalue of 
*” Oisazero of ヵ 


e 之 the constant term of ヵ is 0, 


where the frst equivalence holds by 5.7, the second equivalence holds by 5.27(a), 
and the last equivalence holds because the constant term of ヵ equals ヵ (0). 


7ge7r の es 77 の 7- の 女 7e7257O7 の 7 が eg/ Vec7o7 SC@y 


The next result will be the key tool that we use to show that every operator on an 
odd-dimensional real Vector space has an eigenvalue. 


5.33 eve7- の 7777672S7O727 727777 y の gce 


SupposeF = RandVis finite-dimensional. Suppose also that 7 々 () 
and ヵ c と Rowith だ <4c. Then dimnull(7 テ + の +g7) is an even number. 


Proof Recall that null(72+ 7+c7) is invariant under 7 (by 3.18). By replacing 

with null(72+7+c7) and replacing 7 with 7restricted to null(7 テ + 7+ 7), 

we can assume that72+ 7 +c7 0: we now need to prove that dimV is even. 
Suppose ル Rando と Vare such that 7o = Ao. Then 


0= (72+7+ go= (2+ 太 To = ((Q+ +c- 衝 jp 


The term in 1arge parentheses above is a positive number. Thus the equation above 
implies thato=0. Hence we have shown that 7 has no eigenvectors. 

Let be asubspace of り thatis invariant under 7 and has the largest dimension 
among all subspaces of that are invariant under 7 and have even dimension. 
= ニ ツ then we are done: otherwise assume there exists の Vsuchthat ee. 

Let W = span( の ,7zo). Then W is invariant under 7 because 7(7) = 
ーp7 一 co の . Furthermore, dim W = 2 because otherwise の would be an eigen- 
Vector of 了 ア , Now 


dim(+W) = dim+dimWーdim(Un W) = dim+ 2, 


where nMW = (0) because otherwise 7 nMW would be a one-dimensional 
subspace of Pthat is invariant under ア (impossible because 7 has no eieenvectors). 
Because + W is invariant under 了 , the equation above shows that there exists 
asubspace of invariant under 了 of even dimension larger than dim /. Thus the 
assumption that リ チレ was incorrect. Hence V has even dimension. 
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The next result states that on odd-dimensional vector spDaces, eVery ODerator 
has an eigenvalue. We already know this result for finite-dimensional complex 
Vectors spaces (without the odd hypothesis). Thus in the proof below, we will 
assume thatF =R. 


5.34 Op@77O7 ゞ の 77 の 7-777767297O779/ VeC7O7 ゞ PC@ ゞ 7 の Ve 67ge77D/7/e ゞ 


Every operator on an odd-dimensional Vector space has an eigenvalue. 


Proof SupposeF =RandVis fnite-dimensional. Let 7 = dmV and suppose 
71s an odd number. Let ア と 々 (). We will use induction on 7 in steDs Of size 
two to show that ア has an eigenvalue. 1O get started, note that the desired result 
holds if dimV = 1 because then every nonZero vector in V is an eigenvector of 李 

Now suppose that ヵ > 3 and the desired result holds for all operators on all 
odd-dimensional vector spaces of dimension less than 7. Letp denote the minimal 
polynomial of 7 f ヵ is a polynomial multiple of ャ ー ル for some ん R, then ん is 
an eigenvalue of |by 5.27(a) | and we are done. Thus we can assume that there 
exist ヵ ,c  R suchthat だ <4candpis apolynomial multiple of xc(See 
4.16). 

There exists a monic polynomial 7 ア (R) such that p(Y) = 9(*) (x++c) 
forallxER.Now 


0= ニ ヵ (①⑦) = (7①))(7 ブ ォ 好 6 


which means that 9(7) equals 0 on range(7^+ 7 + 7 の). Because deg 9 < deg ヵ 
and ヵ is the minimal polynomial of 7, this implies that range(7 テ + の +g7) チ 
The fundamental theorem of linear maps (3.21) tells us that 


dim ソ = dimnull(7 テ + の +g7) +dimrange(72+ 7+cD. 


Because dim V is odd (by hypothesis) and dim null(7 タ + 好 + 7) is even (by 5.33)、 
the equation above shows that dimrange(7 テ + の +g) is odd. 

Hence range(7^+ 7 +o7) is a subspace of that is invariant under 7 (by 
3.18) and that has odd dimension less than dim . Our inducton hypothesis now 
implies that restricted to range(7-+ 7 + 7) has an eigenvalue, which means 
that 了 has an eigenvalue. 


See Exercise 23 in Section SB and Bxercise 10 in Section 9C for alternative 
proofs of the result above. 


re7C7yey うど 


1 Suppose 7 と 々 ( ゆ ). Prove that 9 is an eigenvalue of72 iandonlyif3or 
ー3 is an eigenvalue of 了 ア 


2 Suppose V is a complex Vector space and 7 と 々 (V) has no eigenvalues. 
Prove that every subspace of Vinvariant under 7 is either {0) or infimite- 
dimensional. 


10 


11 
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Suppose 7 iS a positive integer and 7 ヒー ん (E”) is defined by 


7 (00) 王 (キキ 6 キー TA) 


(a) Hind all eigenvalues and eigenvectors of 7 
(b) Hind the minimal polynomial of 7 


77e 77r の 7 7 w777 7es の ec7 7 の 77e 5772 の 7 の の 575 の 7 F" co が oy 7 g77 1 5. 


SupposeF = C,7 ー バ ( ゆ ), ヵ 6 の (C), and z と C. Prove that wis an 
eigenvalue of ヵ ず ) せ and only 導 w ニ ヵ (ん ) for some eisenvalue ん of 好 ア 


Give an example of an operator on R< that shows the result in Exercise 4 
does not hold if C isreplaced with R. 


Suppose 7 (FE^) is defined by 7( の ,z) = (一 Z, の ). Find the minimal 
polynomial of 7 


(a) Give an example of 5.7 と (F^) such that the minimal polynomial of 
S7 does not equal the minimal polynomial of 了 S. 

(b) Suppose V is finite-dimensional and 5,7 々 ( ゆ ). Prove that if at least 
one of 5, 了 is invertible, then the minimal polynomial of S7 equals the 
minimal polynomial of 75S. 


万 た Sow 太 7 が 5 fs ve77 が の /e g7 の 7 三 の (F), 太 ez p(7S) = 5- ヵ (57)5. 


Suppose 7 々 (R^) is the operator of counterclockwise rotation by 1". Find 
the minimal polynomial of 7 ア 


jecgse dimR< = 2 万 e eg7ee の 娘 e 7 Poo777 の 7 了 が な 7 7o57 2. 
77s 娘 e 27 の 7 po/y7O77727 の 7 了 7 が s 7 の 7 7e 7e7 の 7 が 7g po の yo77g/ xT90 1 
eve 7ogn 7190 二子 


Suppose 7 と 々 () is such that with respect to some basis of all entries 
of the matrix of are rational numbers. Explain why all coeficients of the 
minimal polynomial of 7 are rational numbers. 


Suppose V is finite-dimensional, 7 と 々 ( じ ), andoV Prove that 
span( の , 7 の , .… Tp) = span( の , 了 op, …,79m ザ ー1 の ) 

for all integers 7 > dim ソ ピー1. 

Suppose is a two-dimensional vector space, 7 々 (), and the matrix of 


了 with respect to some basis of is ( 6 1 ) 


(a) Show that 7 ケー (4+ の 7T+ (249ーpc)7 =0. 
(b) Show that the minimal polynomial of equals 


ターg if りー ニ c= ニ 0and4= ニ み 
zー 7 二 の z 二 (7ー) otherwise. 
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Defne 了 と (F") by (Yo 3 ) 三 (」, 27, 3Y っ ,…, 7 ). Find the 
minimal polynomial of 李 


Suppose 7 々 (げじ) and ヵ と の (F). Prove that there exists a unique7 の (F) 
such that 7/(7) = 7) and deg7 is less than the degree of the minimal 
polynomial of 7 ア 


Suppose V is fimite-dimensional and7 と 々 (V) has minimal polynomial 
4+ 5z 一 6 ダー72 ォ 223 本 z?. Hind the minimal polynomial of アート. 


Suppose V is a fimite-dimensional complex vector space with dim ソ >0 
and ア 7 と イ (の ). Defne た で っ Rby 


7(2) = dimranee7ーA7). 
Prove that is not a continuous function. 


Suppose の,…。 5 F. Let 了 be the operator on F" whose matrix (with 
respect to the standard basis) is 


0 ー0 
1 0 ーg1 
1 ー の 2 
ーー2 
ーー1 


Here all entries of the matrix are 0 except for all 1"s on the Hne under the 
diagonal and the entries in the last column (some of which migsht also be 0). 
Show that the minimal polynomial of is the polynomial 


209 寺 本 タキ ーー ュ ダ ー ト エ z7. 


77e 7 が 7 の oOve が Cg//eg 777e co7 の 727072 772 の 7777 の / 77e の 7 の 7777 の 7 の の re. 
7775 ere7c/Se SOwy 77d7 eve7y 777O777C の の の 77 の 777G7 75 娘 e 7777277297 の /y74 の 77777 
の 7 yo7776 の 67 の 7O7: 万 e72ce の 7 の 77777772 O7 77 97go77777777 727 CO7/7 /7 の og7zce 
er の C7 @79672V/7ze ゞ / の 7 egC77 O の 6777 の 7 O77 6gC77 F” coz/ 777e77 7 の gd7/Ce 6 の C7 
<e7 の y 7/ の 7 ego77 po/ カ 727 が 7g7 [の う .27( の |. 77 7e7e 7 な 7O szC7 277727777 の 7 
g/go77 如 77. 万 oeve7 e 放 cze777 77777677C 776777O5 er/57 7/27 の の 72777776 Ve7y 8 の 0 の 
@//7 の 7777977 の 7 / の 7 77e e7ge77D7/74e の 77 O の 67 の 7 の た 


Suppose V is finite-dimensional, 了 と ズ (), andpis the minimal polynomial 
of 了 7. Suppose ん と F. Show that the minimal polynomial of アー Ar is the 
polynomial 7 defined by 7(Z) = ニカ (Z+ ハル ). 


Suppose V is finite-dimensional, 了 7 と ズ (), andpis the minimal polynomial 
of 李 Suppose ん FE\{0). Show that the minimal polynomial of 4 ア is the 


polynomial 7 defined by 7(z) = AP p( ェ ) 


19 


20 


21 


22 


23 


24 


25 


26 


27 


28 


29 


Section 5B The Minimal Polynomial 153 


Suppose V is fimite-dimensional and ア 7 と る ( ゆ ). Let ど と be the subspace of 
々 () defmned by 
と = 人 7) :9 モ ア )} 


Prove that dim 〆 equals the degree of the minimal polynomial of 李 


Suppose 7 (FE*) is such that the eigenvalues of 7 are 3, 5,8. Prove that 
7ー3D27ー5D2ー8D 人 =0. 
Suppose V is finite-dimensional and ア と (). Prove that the minimal 
polynomial of 了 has degree at most 1 + dimrange 了 了 ア . 

が dimrangee 了 < dim ソー 1, 如 e7 7 ere7c7se 87ey の e77e7 7 の の @7 oz77 の 


7g77 う .22 7 娘 e deg7ee o/ 777e 777777777 の 7 の 7777 の 7 ア 


Suppose V is finite-dimensional and 了 と 々 ( じ ). Prove that ア is inVertible if 
and only if7 と span(7,72 .…79m ザ ). 


Suppose is finite-dimensional and 7 ん ( ゆ ). Let ヵ = dimV Prove that 
ifo と then span( の ,7o,…7"ー1o) is invariant under 好 


Suppose is a fnite-dimensional complex Vector space. Suppose 7 々 ( げ ) 
is such that 5 and 6 are eigenvalues of 7 and that ア has no other eigenvalues. 
Prove that 7ー57)9mY-1 ア ーー67)9mY-1 ニ 0. 


Suppose V is finite-dimensional, 了 7 と 々 (), and is a subspace of that 
is invariant under 7 了 * 


(a) Prove that the minimal polynomial of is a polynomial multiple of the 
minimal polynomial of the quotient operator 7/U. 


(b) Prove that 
(minimal polynomial of |) x (minimal polynomial of 7/ け ) 
is a polynomial multiple of the minimal polynomial of ア 


77e 7 の 776777 の 67 の 7O7 了 / yy 677769 7 万 Ye7c7/Se 39 772 Sec7 の 7 う 4. 


Suppose V is finite-dimensional, 7 と 々 (ゆり ), and is a subspace of that 
is invariant under 7. Prove that the set of eigenvalues of equals the union 
of the set of eigenvalues of |,, and the set of eisgenvalues of 了 /U. 


SupposeF = R, Vis finite-dimensional, and 7 々 (の). Prove that the 
minimal polynomial of 7 equals the minimal polynomial of 7 ア 


77e co7 の /er77cd77O7 7 て Ws de7777eg 7 Ye7c75e 3 の 7 5ec77o7 う . 
Suppose V is finite-dimensional and ア と (). Prove that the minimal 
polynomial of ア " と ん ( ぴ 「) equals the minimal polynomial of 了 李 

77e 7 7 が の の 7 gs の 6 太 7e の 7 Sec7O77 うた 


Show that every operator on a finite-dimensional vector space of dimension 
at least two has an invariant subspace of dimension two. 


re7c7ye 0 777 Sec7zo7 う C 777 gzve 7 7 の 7 の Ve77677 の 7 7775 7es77 ez7F =C. 
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う C ppe た 77727677777 人 7777Cey 


Im Chapter 3 we defined the matrix ofa linear map from a finite-dimensional vector 
Space to another finite-dimensional vector space. That matrix depends on a choice 
of basis of each of the two Vector spaces. Now that we are studying operators, 
which map a Vector space to itself, the emphasis is on using only one basis. 


5.35 gdefinition: 7777r の 7 72 O/@7g7 の 7 7(7) 


Suppose 7 々 ( じ ). The 277z の 了 ア with respect to a basis の 」, …, の , Of Vs 
the 7-by-7 matrix 


人 41 ュ 
777) = 
2 


whose entries 4 , are defned by 


ナ ? 三 1 の pm GO ゴロ 2 の 


The notation 7 (7, (の 」,……, の ,) ) 1S used ithe basis is not clear from the context. 


Operators have square matrices (meaning that the number of rows equals the 
number of columns), rather than the more general rectangular matrices that we 
considered earlier for linear maps. 

TT7 is an operator on F” and no ba- 
sis is specified, assume that the basis in 
question is the standard one (where the 
直 basis vector is 1 in the slot and 0 
in all other slots). You can then think of 
the column of 77(7) as 7 applied to the basis vector, where we identify 
7-by-1 column vectors with elements of F" 


5.36 example: 7 の げ 72 OP67 の 7 の 7 777 76y/eC7 7 の 5777 の 77 の 975 


Define 7 と /(E?) by 7(x, ,Z) 三 (2 ァ + 7,5y + 3z, 8z). Then the matrix of 子 
with respect to the standard basis of E? is 


77e 7 co/7 の 太 e 7 が 婦 77 7) な 
772e9 万 o77 77e coe 廊 c7e7775 4ye7 7O 
7776 7 の 。 の 5 の 77767 CO77 の 777777 の 72 の / 


7e の 575 の] ,…, の 


2 1 0 
2777)=| 0 5 3 1, 
0 0 8 
as yoOu should verify. 


A central goal of Hinear alsebra is to show that given an operator 7 on a finite- 
dimensional vector space there exists a basis of with respect to which ア has 
a reasonably simple matrix. TO make this vague formulation a bit more precise, 
we might try to choose a basis of such that 77 (7) has many 0's. 
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is a finite-dimensional complex Vector space, then we already know 
enough to show that there is a basis of with respect to which the matrix of 子 
has 0's everywhere in the frst column, except possibly the frst entry. In other 
words, there is a basis of with respect to which the matrix of looks hke 


ル 

0 * 

0 
here * denotes the entries in all columns other than the frst column. To prove 
this, let ル be an eigenvalue of ア (one exists by 5.19) and let obe a corresponding 
eieenvector. Extendoto a basis of V Then the matrix of 7 with respect to this 


basis has the form above. Soon we will see that we can choose a basis of with 
respect to which the matrix of7 has even more 0's. 


For example, the diagonal of the matrix 


2 1 0 
wms|g ssl 
0 0 8 


from Example 5.36 consists of the entries 2, 5, 8, which are shown in red in the 
matrix above. 


For example, the 3-by-3 matrix above is upper triangular. 
Typically we represent an upper-triangular matrix in the form 


| 。 | 
0 ん 


the 0 in the matrix above indicates that We o77e77 456 * 7 の de72O7e 7 の 7 67777765 
all entries below the diagonal in thiS 訪 Z7we 6 7o7 ov o7 放 g7 7e が 7e/e- 
な -by-7 matrix edual 0. Upper-triangular 77o 太 e es が os の eng が ssse の 
matrices can be considered reasonably 

simple 一 if 7 is large, then at least almost half the entries in an 77-by-7 uDDeT- 
triangular matrix are 0. 
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The nextresult provides a useful connection between upper-triangular matrices 
and invariant subsDaces. 


5.39 co74d777O775 /27 7 の の 67-7772g7477 777777 


Suppose 7 三 々 ( じ ) and ,.……, の, 1S a basis of じ Then the following are 
eduivalent. 


(a) The matrix of 7 with respect to の 」, …, の , 1S UDDer triangular. 


(b) span( の 」, .…, Cr) 1S inVariant under 7 for each た = 1, .…,7. 


(c) 7o, 6 span(o」, .…, の) for each = 1,.…,7. 


Proof Hirst suppose (a) holds. To prove that (b) holds, suppose た {1, …, ヵ ). せ 
7 人 1, …,7)。 then 
了 の 三 SDan(?, … の) 


because the matrix of 7 with respect to の 」,…, の, 1S UDDer triangular. Because 


SDan( の ],…, の ,) て SDan( の ],…, Cr) 攻 7/ くん た we see that 
1 三 SDan( の 」, ……, の) 


for each 7 {1, ……, 盛 . Thus span( の 」, …, の ) 1S invariant under 了 , completng the 
proof that (a) implies (b). 

Now suppose (b) holds, so span( の 」, .…, or) 1S invariant under 7 for each 
た = 1,.…,77. In particular, 7?, span( の 」,.…, のみ) for each = 1,.…,7. Thus 
(b) implies (c). 

Now suppose (c) holds, so 7?, span( の 」,…, で) for each た = 1,…,7. This 
means that when writing each 7or as a Hmnear combination of the basis Vectors 
の っ の) We need to use only the vectors o」, …,C. Hence all entries under the 
diagonal of 7) are 0. Thus 7 7) is an upper-triangular matrix, completing 
the proof that (c) implies (8). 

We have shown that (a) = (b) = (c) = 学 (@⑫), which shows that (a), (b), 
and (c) are equivalent. 


The next result tells us that ザー /( ぴ ) and with respect to some basis of レ 


we have 
4 ネ 
で ー | 
0 ん 


then 7 satisfies a simple equation depending on A」, … ん ,. 


5.40 ed77O72 77577e7 の Ope77O7 7777 7 の 67-7772574777 7779777 


Suppose 7 古 々 (V) and り has a basis with respect to which 7 has an upper- 


triangular matrix with diagonal entries 」, .…, ん ,. Then 


(OO0 ー 2) 三 0 
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Proof Let o」, .…, の , denote a basis of V with respect to which 7 has an upper- 
triangular matrix with diagonal entries A」, .…, ん, Then 7o」 = Ao」, which 
means that ザー ルル の o」 = 0, which implies that ザール 4 の … デ ブー ルル の 6 = 0for 
7 三 1 …。7(using the commutativity of each7ー ル J ナ with each アー ん ル の . 

Note that ザー ス 457o。 6 span(?」). Thus ゲー ス 4 の ー 4 の g = 0(by 
the previous paraeraph), which imples that 7ー ル 4 の … ブ ブール og = 0for 
7 三 2.….7(using the commutativity of each ア ーAJ/with each ア ー ル J). 

Note that (7 ー A。)o。 ヒビ span( の 」, の >). Thus by the previous paragraph, 
(ザール 4 の 7ー45 の (ザール の gs = 0, which implies that (ザー4」 の … ブ ザー ん ル の の] = 0 
for 77 = 3 .…,77 (using the commutativity of each ア ー 4J with each ア ー ル の. 

Continuing this pattern, we see that (ゲール 41 の … ブ デー ん ル の og = 0 for each 
た = 1,.…,77. Thus ブー ル 4 の …7ー ん の 1S the 0 operator because it is 0 on each 
Vector in a basis of 


Unfortunately no method exists for exactly computing the eigenvalues of an 
operator from its matrix. However, if we are fortunate enough to fnd a basis with 
respect to which the matrix of the operator is upper triangular, then the problem 
of computing the eigenvalues becomes trivial, as the next result shows. 


5.41 ge/e7777777d77O7 7 @7ge74D7776y 放 の 777 7 の の 6 た 7777287477 7777777 


Suppose 7 々 ( じ ) has an upper-triangular matrix with respect to some basis 


of Then the eigenvalues of ア are precisely the entries on the diagonal of 
that upper-triangular matrix. 


Proof Suppose の ], …, の 。 1S a basis of with respect to which 7 has an upper- 


triangular matrix 
4 玉 
277) = … | 
0 ん 


Because 了 ?o」 = の 」, We see that A」 is an eigenvalue of 7 
Suppose た {2,.…,7. Then デール の span( の 」,… 1). Thus デ ザー ルナ 
maps SDan( の ], …, Cr) 1ntO SDan( の ],…, の _ ュ ). Because 


dim span(o」, …, の ) 三 ん た and dimspan( の 」,…, のみ) ニル た ー 1 


this implies that アール restricted to span( の 」, …, Cr) 1S not injective (by 3.22). 
Thus there exists o 三 span( の 」, .…, の ) Such that の チチ 0and ゲール の)o = 0. Thus 
Az is an eigenvalue of 了 . Hence we have shown that every entry on the diagonal 
of 77(7) is an eigenvalue of 

To prove 了 has no other eigenvalues, let 7 be the polynomial defined by 
(2) = (ター 41)…(z 一 ん ). Then 7(7) = 0 (by 5.40). Hence 7 is a polynomial 
multple of the minimal polynomial of (by 5.29). Thus every zero of the minimal 
polynomial of 了 isa zero of. Because the zeros of the minimal polynomial of 
7 了 are the eieenvalues of (by 5.27), this implies that every eigenvalue of 了 ア isa 
Zero of 7. Hence the eisenvalues of are all contained in the Hst 和 A」,…, ん 。. 
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5.42 example: e7ge77774ey V7 72 7 の の @7-777472874797 77777 


Define 7 と /(E?) by (yz) = (2 ァ + 57 + 3z, 8z). The matrix of 了 with 
respect to the standard basis is 


2 1 0 
777⑦)=| 0 5 3 1. 
0 0 8 
Now 5.41 implies that the eisgenvalues of 了 are 2, 5, and 8. 
The next example illustrates 5.44: an operator has an upper-triangular matrix 


with respect to some basis if and only if the minimal polynomial of the operator 
is the product of polynomials of desree 1. 


5.43 example: ye77er7 了 5 72 7 の の 6 た 77748747 の 7 77977 C の 77 の 6 の 677 O77 


Defne 7 と 々 (F?) by 
了 (Z], 2 っ, 3, Z4) 三 (一 2, 1, 2Z」 二 32Z3, Zs 二 324). 


Thus with respect to the standard basis of F*, the matrix of 7 js 


0 -1 0 0 
1 0 0 0 
2 0 3 0 
0 0 1 3 


You can ask a computer to verify that the minimal polynomial of is the polyno- 
mial ヵ defmed by 
(2Z) ニ =9ー6z+10z2ー622+T 4 
First consider the case F = R. Then the polynomial ヵ factors as 
P( 々 ) = ( ダ +1) 々 ー3)@ー3③), 


with no further factorization of z^+ 1 as the product of two polynomials of degree 
1 with real coeffcients. Thus $.44 states that there does not exist a basis of R* 
with respect to which has an upper-triangular matrix. 

Now consider the caseF = C. Then the polynomial り factors as 


P(Z) = ( 々 一 の ②+ の ( 々 ー3)( 々 一 3③), 
where all factors above have the formzーA,. Thus 5.44 states that there is a basis of 
C* with respect to which 7 has an upper-triangular matrix. Indeed, you can verify 
that with respect to the basis (4 一 37, 3 一 47 一 3 二 7.1)。(4+37. 一 3 二 47 一 3 一 7.1), 
(0,0,0,1),(0,0,1,0) of C*, the operator 了 has the upper-triangular matrix 
7 0 0O 0O 
0 - ヵ 7 0 0 
0 0 3 1 
0 0 0 3 
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5.44 7ecessd7y G72 s77 太 c7e777 CO72 の 777O72 7 の /72Ve 77 77 の の 6 た 7772874777 7779777 


Suppose V is finite-dimensional and7 々 (ゆり ). Then 7 has an upper- 


triangular matrix with respect to some basis of 「 証 and only (he minimal 
polynomial of 7 equals (z 一 A」)…( 々 ー ルル ) for some ん, …, ん ん, F. 


Proof Hirst suppose 7 has an upper-triangular matrix with respect to some basis 
of Let w」, …, w, denote the diagonal entries of that matrix. Define a polynomial 
7 モア で ) by 

2) ニ (ター 1)…( タ ー 4)- 


Then 7(7) = 0, by 3.40. Hence 7 is a polynomial multiple of the minimal polyno- 
mial of 了 , by 5.29. Thus the minimal polynomial of equals ( 々 ー 41)…( 々 ー ルル) 
for some 4,… ん ル ん, EE with (1 ん) て (1)…) の) 

To prove the implication in the other direction, now suppose the minimal 
polynomial of equals (一 1)…( ヶ 一 ん) for some A,……, 和 ん F. We will use 
induction on 77. TO get started, 導 77 = 1thenz 一 人 is the minimal polynomial of 
了 , which implies that 7 = 7 which implies that the matrix of (with respect 
to any basis of ) iS upper triangular. 

Now suppose 77 > 1 and the desired result holds for all smaller positive 
integers. Let 

=rangee ず ー ル の . 


Then U is invariant under 7 [this is a special case of 5.18 with p(Z) ニッ ー ル |. 
Thus 7 is an operator on U. 
IffzEU,then み = ニブ ザー ん ル 2 for some go と and 


ー4 の …⑦ー ス 17Dg ニ ザー41)…ー44Do =0. 


Hence (z 一 1)…(z 一 ん ルー ュ ) 1S a polynomial multiple of the minimal polynomial 
of 本, by 5.29. Thus the minimal polynomial of | is the product of at most 
77 一 1 terms of the formz 一 ん 

By our induction hypothesis, there is a basis 4 ,……, 7 Of プリ with respect to 
which 7|, has an upper-triangular matrix. Thus for each た {1, …, ん), we have 
(using 5.39) 


5.45 ナニ (|)() Span ,… )・ 


Extend 7 ,…, 74 【O a basis 7 …) 2 の … っ の v Of V For each た (1, …, 内), 
We have 
J ナ ? 一 (7 了 ーー ん ル の の キ ルル の. 


The definition of shows that ザー ルリ の oc とけ = span( 各 ,…, 244). Thus the 
equation above shows that 


5.46 ナ ?, SDan(7 ,…, 2 の 1 …) の /)・ 


From 5.45 and 5.46, we conclude (using 5.39) that 7 has an upper-triangular 
matrix with respect to the basis 4 … 2 の) …) Or Of Was desired. 
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The set of numbers {A」, .…, ん 。) from the previous result equals the set of 
eigenvalues of (because the set of zeros of the minimal polynomial of 7 equals 
the set of eisgenvalues of 了 了 , by 5.27), although the Hst A」, … ん in the previous 
result may contain repetitions. 

In Chapter 8 we will improve even the wonderful result below: see 8.37 and 
8.46. 


5.47 が ドニ CC, 娘 e7, eve7y O/67 の 7 の 7 O77 V 45 72 7 の 67-7777787477 777777 て 


Suppose V is a finite-dimensional complex Vector space and 7 ん (). Then 
7 has an upper-triangular matrix with respect to some basis of 


Proof The desired result follows immediately from 5.44 and the second version 
of the fundamental theorem of algebra (see 4.13). 


For an extension of the result above to two operators 5 and ア such that 
S ア 7 ニ 75, 


see 5.80. Also, for an extension to more than two operators, see Exercise 9(b) in 
Section 5E. 

Caution: If an operator 7 と 々 ( ぴ ) has a upper-triangular matrix with respect 
to some basis の 」, .…, の , Of then the eigenvalues of 了 are exactly the entries on 
the diagonal of 77(7), as shown by 5.41, and furthermore o」 is an eigenvector of 
了 . However, の 。, .…, の need not be eigenvectors of 了 . Indeed, a basis vector o, 1S 
an eigenvector of 了 if and only if all entries in the A び column of the matrix of 7 
are 0, except possibly the entry. 

You may recal from a preVious 77e 7ow ec7e/o7 / め 7772 の 7 7 が e 7227 巡 
course that every matrix of numbers can の gz Ope7g7Or の ey 7O7 gfue 9 の 7 が 97 
be changedtoamatrixinWhatiscalled  / 訪 e ezgezvg/es の 7 太 e ope7g7o7 7 
row echelon form. IT one begins With a co が Zs/ の 7 の pe た が 72767777 7 が 刀 
square matrix, the matrix in row echelon 7 7espec7 7O so7ze の gs/5 giyey 49 の 
form will be an upper-triangular matrix.  / が s7 o7 7 7e ezge7yd/zesy の 7 7 が e op- 
Do not confuse this upper-triangular ma- eg7o7: oweve7, 7e7e 75 7 の 77e77o の 
trix with the upper-triangular matrix of 7 co7z/77g 6XC7 の ys4C77 7 7 の De た 
an operator with respect to some basiS 7 が 77g0427 7 か 大, eVe72 7 が og77 う . イ / 
whose existence is proclaimed by 5.47 (if 8 の 7g77ee5 7Z5 eX7S77C@e が ドニ CC 
F =C) 一 there is no connection between 
these upper-triangular matrices. 


re7czyey うじ 


1 Proveorgiveacounterexample: IT7 と 々 (P) and 7 テ has an upper-triangular 
matrix with respect to some basis of V then 7 has an upper-triangular matrix 
with respect to some basis of K 
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Suppose 4 and ぢ are upper-triangular matrices of the same size, with 
っ ルル 。 On the diagonal of 4 and 8, …, on the diagonal of . 


(&) Show that 4+ pis an upper-triangular matrix with %」 十 8」,…,。 十 。 
on the diagonal. 

(b) Show that 4 is an upper-triangular matrix with y]」, …, ル ,, On the 
diagonal. 


77e 7ey7775 772 7775 ee7C7/Se g7 746 772 77e 7 の oO7 の 7 う .67. 


Suppose 7 と () is invertible and ?」,…, の , 1S a basis of V with respect 
to which the matrix of is upper triangular, with AA, .……, ん, on the diagonal. 
Show that the matrix of アー「 is also upper triangular with respect to the basis 
の … の With 


on the diagonal. 


Give an example of an operator whose matrix with respect to some basis 
contains only 0's on the diagonal, but the operator is invertible. 


777s ere7C7Se 7 の 77e ere7c7se の e/ow sow 7 が 47 5./ 認 7 が 5 7 が の 77 7 が e が Do77- 
@575 7777 72 4 の 6 た 777774674777 777777 7 7 の 67 CO7457 の e7 の 77O77. 


Give an example of an operator whose matrix with respect to some basis 
contains only nonzero numbers on the diagonal, but the operator is not 
invertible. 


SupposeF = C, Vis finite-dimensional, and7 と 々 (ゆり). Prove that 
た 代 ,.…, dm り ), then り has a た dimensional subspace invariant under 7 


Suppose V is finite-dimensional, 7 と 々 (の), ando と 


(a) Prove that there exists a uniqgue monic polynomial p。 of smallest degree 
such that (7)o = 0. 
(b) Prove that the minimal polynomial of 了 is a polynomial multiple of ヵ 。. 


Suppose V is fimite-dimensional, 7 々 ( ぴ ), and there exists a nonZero 
vectoro と Vsuch that 2o + 27o = ー2o. 


(a) Prove that ifEF = R, then there does not exist a basis of V with respect 
to which 7 has an upper-triangular matrix. 

(b) Prove that if = Cand 4 is an upper-triangular matrix that equals 
the matrix of ア with respect to some basis of then 一 1 二 7or 一 1 一 7 
appears on the diasonal of 4. 


Suppose ぢ is a square matrix with complex entries. Prove that there exists 
an invertible square matrix 4 with complex entries such that 4~!4 is an 
upper-triangular matrix. 
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Suppose 7 と 々 (V) and の ,… の 。 1S a basis of じ Show that the following 
are equivalent. 

(&) The matrix of 了 with respect to の 」,.…,6, 1S lower triangular. 

(b) span( の , …, の,) 1S invariant under 7 for each ん = 1,.…,7. 

(c) To 6 span( の 。。 の ) for each = 1,…,7. 


4 sd7e 7777 75 Cg7/e7 7 の we7 77274574727 が 677 e77777ey の ove 77e 4gO746/ 
g7e 0. 


SupposeF = Cand Vis finite-dimensional. Prove that ザ 了 と 々 ( ゆ ), then 
there exists a basis of with respect to which ア has a lower-triangular matrix. 


Suppose V is finite-dimensional, 了 7 と 々 () has an upper-triangular matrix 
with respect to some basis of and Uisasubspace of that is invariant 
under 7 ア 


(a) Prove that has an upper-triangular matrix with respect to some basis 
of U. 

(b) Prove that the quotient operator 7/ has an upper-triangular matrix with 
respect to some basis of V/U. 


77e 7 の 776777 67 の 7O7 了 / 7 yy の e77769 7 万 e7c7/Se づ 9 772 Sec7 の 7 う 4. 


Suppose V is finite-dimensional and 7 と 々 ( ゆ ). Suppose there exists 
a subspace リ of that is invariant under 7 such that 本 has an upper- 
triangular matrix with respect to some basis of and also 77/ has an 
upper-triangular matrix with respect to some basis of V/U. Prove that ア has 
an upper-triangular matrix with respect to some basis of 


Suppose is finite-dimensional and 7 々 ( ぴ ). Prove that 了 has an upper- 
triangular matrix with respect to some basis of Vi and only if the dual 
operator 7” has an upper-triangular matrix with respect to some basis of the 
dual space ぴ " 
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う / の ggo7g/7zg の /e ひ /e777O7y 


72go7g/ 74777cey 


A ZZgozg7 7 が 7 尋 1S a sduare matrix that is 0 everywhere except possibly on 
the diasonal. 


1s a diagonal matrix. 


Tanoperatorhasa diagonalmatrix 。 erD_ g の 2gO797 の 7 S の Per 7 た 
with respect to some basis, then the en- gz/g の gong7 77Z7fces の picg7D 
tries on the diagonal are precisely the ue 万 の y 加 O7e 0 5 太 Z7 77057 Pe た 
eigenvalues of the operator: this follOWS ez/Z7 77ces の 7 7e y の 77e s/e. 
from 5.41 (or find an easier direct proof 
for diagonal matrices). 


An operator on is called 2go7g/ が < の /e if the operator has a diagonal matrix 
with respect to some basis of K 


| 5.51 example: go74477<g7O72 7 の y 76 の 74776 の の 7 ガ c7e777 の 2y75 


Defne7 と 々 (RS) by 
了 (,) ニ (41 と 77 一 20r 747). 
The matrix of7 with respect to the standard basis ofR< is 
41 Z 
ー-20 74 だ 
which is not a diagonal matrix. However, 7 is diagonalizable. Specifically, the 
matrix of 了 with respect to the basis (1,4), (7,5) js 


69 0 
0 46 


because 7(1,4) = (69,276) = 69(1,4) and 7(7,5) = (322, 230) = 46(7,5). 


164 Chapter5 Eigenvalues and Eigenvectors 


For ん と FE, we will find it convenient to have a name and a notation for the set 
of vectors that an operator 了 maps to ル times the vector. 


5.52 gefinition: ezge7yPgce, (和子 ) 


Suppose 7 々 (V) and ん FE. The e7gezypgce of 7 corresponding to ん is 
the subspace と (ん, 了 ) of defined by 


(4, 了 7) = null7ー ル AD) =( の と モリ: イタ テル の . 


Hence E( 和 ん, 了 了 ) is the set of all eisgenvectors of 7 corresponding to , along 
with the 0 Vector. 


For7 と 々 ( げ ) and ル ん 6 FE, the set E( 和 ん , ア ) is a subspace of because the null 
space of each linear maponVisasubspace of The defimitions imply that Ais 
an eiegenvalue of 了 闘 and only if E( 和 ん, 了 ア ) チ {0}. 


5.53 example: 67ge775 の DC@? O/ の 77 O/67 の 7 の 7 


Suppose the matrix of an operator 了 と 々 (げじ ) with respect to a basis の 」, の , の ぅ 
of Vis the matrix in Example 5.49. Then 


万 (8, 了 ) = span( の ])。 E(5, 了 ア ) ニ span( の >, の 3). 


Tf Ais an eigenvalue of an operator 7 々 (), then 了 restricted to E( 和 ん , 了 ア ) is 
Just the operator of multiplication by 人 . 


5.54 77777 の 7 67ge775 の の C6y 75 の の 77eC7 77772 


Suppose 7 々 ( じ ) and 4」, .…, ん are distinct eigenvalues of 7. Then 
万 (A」, 了 ) acGCOAOR 后 (4 了 ) 


is a direct sum. Furthermore, if V is finite-dimensional, then 


dim EE(A1,7) キー + dim E(A 7) < dm 


Proof To show that E(41,7) +… エ E( ん 4 ア ) 1S a direct sum, SUDDOSe 
の キオ … キ の テリ 0, 


where each or is in E( ん 4, 了 ). Because eigenvectors corresponding to distinct 
eigenvalues are linearly independent (by 5.11), this implies that each o, equals 0. 
Thus (4 7) す … 二 E( ん 4, 李 ) is a direct sum (by 1.45), as desired. 

Now suppose V is finite-dimensional. Then 


dim PE(A1,7) +… dim E( ん 4 77) = dm(E(A1,7) @ … @ E( ん 7) ) 
< mm 


where the frst line follows from 3.94 and the second line follows from 2.37. 
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Co7g777o77y /27 の 7Zgo7g/ が cg の 7777y 


The following characterizations of diagonalizable operators will be useful. 


5.55 co7zd777O72 69747U276777 7 の 7Zgo74 の 77<g の 7777y 


Suppose V is finite-dimensional and7 ん ( ゆ ). Let 4 , .……, ん, denote the 
distinct eigenvalues of 7. Then the following are equivalent. 


(a) 7 jiS diagonalizable. 


(b) has a basis consisting of eigenvectors of 7 
(c) ソ 王 避 。70) に ロン の 六 (2。 7 
(④ dim = dm 5E(A41,7) + … + dim E( ん 7). 


Proof An operator 7 (げじ ) has a diagonal matrix 


。 
0 ん 


with respect to a basis の 」,…, の, Of Vi and only 放 7o, = Ao for each た . Thus 
(a) and (b) are equivalent. 

Suppose (b) holds: thus has a basis consisting of eigenvectors of 了 . Hence 
every Vector in jis a Hinear combination of eigenvectors of 了 , which implies that 


=5B(1,7) キ ー キ 所 ん 。 7 


Now 5.54 shows that (c) holds, provings that (b) implies (c). 
That (c) implies (d) follows immediately from 3.94. 
Finally, suppose (d) holds: thus 


5.56 dm ソ = dmE(A1,7)+… 二 dm EE( ん えん ア ). 


Choose a basis of each E( 和 ん し , ア ): put all these bases together to form a Hist の, …, の , 
of eigenvectors of 了 , where 7 = dimV (by 3.56). 1o show that this Hist is Hinearly 
independent, suppose 

の キ … 二 の の 三 リ 0, 
where 7」, 7 三 F. For each た = 1,.…,77。 et 7, denote the sum of all the terms 
の の Such that (りー (ん ). Thus each 7 1S in E( 和 ん の) and 


キオ … オ 7 ニ U0. 


Because eigenvectors corresponding to distinct eigenvalues are linearly indepen- 
dent (see $.11), this implies that each zz eduals 0. Because each , 1s a sum of 
terms の の , where the の S were chosen to be a basis of E( ん 7), this implies that 
all gs equal 0. Thus の 」,…, の, 1S Hinearly independent and henceisa basis of 
(by 2.38). Thus (d) implies (b), completing the proof. 


For additional conditions equivalent to diagonalizability, see 5.62, Exercises $ 
and 15 in this section, Exercise 24 in Section 7B, and Exercise 1S in Section 8A. 


166 Chapter5 Eigenvalues and Eigenvectors 


As we know, every operator on a fimite-dimensional complex vector SsDace 
has an eigenvalue. However, not every operator on a finite-dimensional complex 
vector space has enough eigenvectors to be diagonalizable, as shown by the next 
exammple. 


5.57 example: 77 の の 7 の 7 の 7 47 7 7O7 go7277< の /e 


Define an operator 7 と 々 (FE?) by 7(2, か c) = ( ち c.0). The matrix of7 with 
respect to the standard basis of F? is 


0 1 0 
0 0 1 |, 
0 0 0 


which is an upper-triangular matrix but is not a diagonal matrix. 
As you should verify, 0 is the only eigenvalue of 7 and furthermore 


E(0,7) = {(g,0.0) EE 2 FE]. 


Hence conditions (b), (c), and (d) of 5.53 fail (of course, because these conditions 
are equivalent it is sufhcient to check that only one of them fails). Thus condition 
(a) of 5.35 also fails. Hence 7 is not diagonalizable, regardless of whetherF =R 
orF=C で . 


The next result shows that i an operator has as many distinct eigenvalues as 
the dimension of its domain, then the operator is diagonalizable. 


5.58  e7zozg7, e7ge72V77465 7 の 77ey 7 の go74477<g/7777y 


Suppose V is finite-dimensional and7 と 々 ( ぴ ) has dim り distinct eigenvalues. 
Then 7 is diagonalizable. 


Proof Suppose 7 has distinct eigenvalues A」,…, Ar. For each let o, ビレ 
be an eigenvector corresponding to the eigenvalue ん,. Because eigenVectOTs COTre- 
sponding to distinct eigenvalues are Hinearly independent (see 5.11), の 」,…, の any 
is hinearly independent. 

A jnearly independent list of dim vectors in is a basis of (see 2.38): thus 
の …> の amy 1S a basis of With respect to this basis consisting of eigenvectors, 
了 Thas a diagonal matrix. 


In later chapters we will find additional conditions that imply that certain 
operators are diagonalizable. For example, see the real spectral theorem (7.29) 
and the complex spectral theorem (7.31). 

The result above gives a sufhcient condition for an operator to be diagonal- 
izable. However, this condition is not necessary. For example, the operator 了 
on F? defined by 7(x, り ,Z) 三 (6x, 6y, 7z) has only two eigenvalues (6 and Z) and 
dim FE? = 3, but 7 is diagonalizable (by the standard basis of E?). 
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The next example illustrates the im- 
portance of diagonalization, which can /ecp7 の es。 yee Exercise 27, wic7 
be used to compute high powers of an 。 訪 oes 7ow 7o se の ggo7g/ 放 7ZO7 の 
operator, taking advantage of the edua- 記 2 ergc7 7 67 太 e 7 7e777 
tion 7*o ニル oi 放 oisan eigenVector of  / げ / 娘 e 盛 Po7gcz sege77Ce. 

7 了 with eigenvalue . 


5.59 example: 5 の 2go7G/7<g77o7 7 の co7 の 7e 7 109 


Define 7 と 々 (E?) by 了 (*,,Z) (2 7,57 + 3z, 8Z). With respect to the 
standard basis, the matrix of ア is 


2 1 0 
0 5 3 |. 
0 0 8 


The matrix above is an upper-triangular matrix but it is not a diagonal matrix. By 
5.41, the eigenvalues of ア are 2, 5, and 8. Because 7 is an operator on a vector 
space of dimension three and ア has three distinct eigenvalues, 3.58 assures us that 
there exists a basis of FE? with respect to which 7 has a diagonal matrix. 

To find this basis, we only have to find an eisgenvector for each eigenvalue. In 
other words, we have to find a nonzero solution to the equation 


7 の 7 g の ec77C7727 の の 7c77O77 の / 777ese 


了 ( テ ,,) 三 人 ル (Y,,Z) 


for = 2,then for ル =5, and then for = 8. Solving these simple equations 
shows thatfor ル =2mwehave an eigenvector (1,0,0),for ん = 5wehave an 
eigenvector (1,3, 0), andfor ル = ニ 8wehave an eisenvector (1,6, 6). 

Thus (1,0,0),(1.3,0),(1,6,6) is a basis of F?consisting of eigenvectors of 7, 
and with respect to this basis the matrix ofis the dagonal matrix 


2 0 0 
0 5 0 | 
0 0 8 


To compute 7T0(0.0,1), for example, write (0,0,1) as a linear combination 
Of our basis of eigenvectors: 


(0.0,1) = &(1.0,0) - (1.30) + を (1.6,6). 
Now apply 7 "0" to both sides of the equation above, getting 
T100(0,0,1) = #(700(1.0.0) ) - (TO.3.0) ) + (TO0.6,6) ) 
= ョ (2001.0.0) - 2・500(1.3.0) + 8001.6.6) ) 


三 MM ー2.5100 」 8100. 6.8100_6. 5100. 6 8100). 
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We saw earlier that an operator 了 on a finite-dimensional Vector space V has an 
upper-triangular matrix with respect to some basis of if and only if the minimal 
polynomial of7 equals (z 一 A」)…(z 一 4 ん) for some A,…, ん F (see 5.44). 
As we previously noted (see 5.47), this condition is always satisfied =C. 

Our next result 5.62 states that an operator 7 々 (げじ ) has a diagonal matrix 
with respect to some basis of iand only ithe minimal polynomial of 了 equals 
(ター41)…( ター ルル) for some sef 和 A」,… ん  F. Before formally stating this 
result, we give two examples of using it. 


5.60 example: の 2eozg/7 が < の /e, の 7 7777 7 の 7OW77 6YC7 679674Pg/746 ゞ 


Defne 7 と 々 (で?) by 
了 (Z], 2 っ, 3, 4, Z5 ) 三 (一 325, る 1 十 6Z5, 2 っ , 3, 4 ) 


The matrix of ア is shown in Example 5.26, where we showed that the minimal 
polynomial of ア Tis3ー6z+ 2". 

As mentioned in Example 5.28, no exact expression is known for any of the 
Zeros Of this polynomial, but numeric techniques show that the zeros of this 
polynomial are approximately 一 1.67, 0.51, 1.40,。 一 0.12 + 1.597,-0.12 - 1.597. 

The software that produces these approximations is accurate to more than 
three digits. Thus these approximations are good enough to show that the five 
numbers above are distinct. The minimal polynomial of 7 equals the fifth degree 
monic polynomial with these zeros. Now 5.62 shows that 7 is diagonalizable. 


5.61 example: sow72g 娘 27 77 の の 677 の 7 5 77O7 の gg の 7777< の の /e 


Define 7 と (FE?) by 


The matrix of7 with respect to the standard basis of E? js 


6 3 4 
0 6 2 |. 
0 0 Z 


The matrix above is an upper-triangular matrix but is not a diagonal matrix. Might 
7 have a diagonal matrix with respect to some other basis of E?7 

To answer this question, we will find the minimal polynomial of 7. First note 
that the eigenvalues of 了 are the diagonal entries of the matrix above (by 5.41). 
Thus the zeros of the minimal polynomial of7 ア are 6, 7 [by 5.27(3)]. The diagonal 
of the matrix above tells us that 7ー67)27 ー 77) = 0 (by 5.40). The minimal 
polynomial of 了 has desree at most 3 (by 5.22). Putting all this together, we see 
that the minimal polynomial of 了 is either (> 一 6)(Zー7) or (Z 一 6)^(z 一 7). 

A simple computation shows that 7ー67)7ー77) チ 0. Thus the minimal 
polynomial of ア is (z 一 6)^(z 一 の ). 

Now 5.62 shows that ア is not diagonalizable. 
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5.62 7ecessq7y 7 の s7/ 放 c7e77 Co72 の 777O7 /27 の 72go7777zg/ の 77 


Suppose V is finite-dimensional and7 と 々 ( ゆ ). Then 7 is diagonalizable if 


and only if the minimal polynomial of ア 7 equals (2 一 A」)…(z 一 ん ) for some 
jist of distinct numbers A,.…, ん,。 と F. 


Proof Hirst suppose 了 ア is diagonalizable. Thus there is a basis の 」,…, の, Of 
consisting of eieenvectors of 7. Let A」,…, ん be the distinct eigenvalues of 7 ア 
Then for each o,, there exists A, with (アール JJ) の 0. Thus 


ーー4D…ー ル 0 =0, 


which implies that the minimal polynomial of ア equals (< 一 A」)…Zー ル ん ル ). 

To prove the implication in the other direction, now suppose the minimal 
polynomial of equals (z 一 4」)…(z 一 4) for some Hist of distinct numbers 
ん っ ん F. Thus 


5.63 介 こ De こん の ョ 0 


We will prove that ア is diagonalizable by induction on 7 娘 . To get started, 
SuDDose 77 三 1. Then ザ デー ルー=0, which means that is a scalar multiple of the 
identity operator, which implies that 7 is diagonalizable. 

Now suppose that 7 > 1 and the desired result holds for all smaller values of 
娘 . The subspace range(7ー ルリ ) is inVariant under 7 [this is a special case of 
5.18 with p(Z) = ニッ ー ル | Thus 7 restricted to rangee す ゲー ルリ ) is an operator on 
raneeー ル の . 

Iffz 三 range サール の,then ニブ ー ル の ofor someo と and 3.63 implies 


5.64 ニール 4DePー え iD ツー ん 4D…mー 和 Do =0. 


Hence (一 1)…(z 一 ん ルー ュ ) 1S a polynomial multiple of the minimal polynomial 
of ア restricted to rangee ザー ルリ ) [by 5.29]. Thus by our induction hypothesis, 
there is a basis of range( ア ザー ルリ ) consisting of eisenvectors of 7. 

Suppose thatz 三 ranee7ー ル リロ nnull ア デー ル の . Then 7 = ルル み . Now 
5.64 implies that 


0=ー44D…mー ル 4。_Dg 
三 (ん 4 デ 4 ル 44)…( ん 4 一 ルー1)7. 


Because 和 」,…, ん, are distinct。 the equation above implies that z = 0. Hence 
ranee7ー ル の) nnul イ プー ルル の =(0). 

Thusrangeー ル の +null( ザ ー ル 7) iS a direct sum (by 1.46) whose dimension 
is dim (by 3.94 and 3.21). Hence rangee ザ デール が) @null( イ ブール ニ V Every 
vector in null( イ ブー ルリ) is an eigenvector of 了 with eigenvalue ん . Earlier in this 
proof we saw that there is a basis of range(7 ー ル ん 7) consisting of eigenvectors 
of 了 ア 7. Adjoining to that basis a basis of nul( ブ ー ル /) gives a basis of V consisting 
of eisenvectors of 了 . The matrix of with respect to this basis is a diagonal 
matrix, as desired. 
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No formula exists for the zeros of polynomials of degree 5 or greater. However, 
the previous result can be used to determine whether an operator on a complex 
Vector space is diagonalizable without even finding approximations of the zeros 
of the minimal polynomial-see Exercise 13. 

The next result will be a key tool when we prove a result about the simul- 
taneous diagonalhization of two operators: see 5.76. Note how the use of the 
characterization of diagonalizable operators in terms of the minimal polynomial 
(see 5.62) leads to a short proof of the next result. 


5.65 7es777c77O77 の 7 go7277<2 の /e O/677O7 7 の 777V の 77777 y7/ の 5 の C6 


Suppose 7 々 () is diagonalizable and Uis asubspace of thatis invariant 
under 了 . Then 7 is a diagonalizable operator on /. 


Proof Because the operator ア is diagonalizable, the minimal polynomial of 李 
eduals (z 一 1)…( ヶ 一 ん ) for some jist of distinct numbers A」,.…, ん, (by 
5.62). The minimal polynomial of7 is a polynomial multple of the minimal 
polynomial of | (by 5.31). Hence the minimal polynomial of 7 has the form 
reduired by 5.62, which shows that 7|, is diagonalizable. 


Ce7y/go7777 の 7y ん 77eo7e777 


5.66 definition: Cersy/go7777 7s ん y 


Suppose 7 と 々 ( ぴ ) and o」, .… の, 1S a basis of / Let 4 denote the matrix of 
7 了 with respect to this basis. A Cezsy7go777z sk of 了 with respect to the basis 
の … っ の, 1S a Set of the form 


k 選 有 li 二 2l Al 
較 


お / 


where 7 {人 1, .…,7 


Because there are 7 choices for / in the defnition above,7 has 7 Gershgorin 
disks. ITF = C, then for each / (1, …,7}。 the RONDONCMM Gershgorin disk 
isaclosed diskin で centered at 4 。, which i is the 由 entry on the diagonal of 4. 
The radius of this closed disk is the sum of the absolute values of the entries in 
row 7 of 4, excluding the diagonal entry. ITF = ニ R, then the Gershgorin disks are 
closed intervals in R. 

In the special case that the square matrix 4 above is a diagonal matrix, each 
Gershgorin disk consists of a single point that is a diagonal entry of 4 (and 
each eigenvalue of is one of those points, as required by the next resul). One 
consequence Of our next result is that if the nondiagonal entries of 4 are small, 
then each eigenvalue of ア is near a diagonal entry of 4. 
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5.67 Cers/go7777 75 ん 777eo7e777 


Suppose 7 々 ( り ) and o」, .……, の , 1S a basis of /. Then each eisenvalue of 李 
is contained in some Oershgorin disk of with respect to the basis の, …, の ,. 


Proof Suppose ル Fisaneigenvalue of 了 7. Lete be a corresponding 
eigenvector. There exist c」, .…,c, 三 F such that 


5.68 の 三 CT の] オー 避 の 


Let 4 denote the matrix of7 ア with respect to the basis の 」, …, の. Applying 了 
to both sides of the equation above gives 


5.69 ん の ニ 2 cr7 の 
た =1 
7 7 
= 2 2 ん 4 の 
ル 三 1 了 ー1 
7 7 
5.70 ニ ( 0。 4 ) み 
=1 い k ニ 1 


Let 7 1, …, ヵ ) be such that 
lg = maxtlg …, le 


Using 5.68, we see that the coeffcient of , on the left side of 5.69 equals Ac,, 
which must equal the coefhcient of o, on the right side of 5.70. In other Words, 


77 
4c: ヒー by 4 C た 
「 王 | 


Subtract 4 :c, from each side of the equation above and then divide both sides 


by oto get 


7 
Ck 
ルー4=| 2 44 
た ニ 1 ) 
た 了 / 


凡 
トブ 
9 


Thus A is in the 中 Gershgorin disk with respect to the basis の 」,…, の ,. 


Exercise 22 giVes a nice applicaton 7 ヵ 。 Ce7ry/go777 7 廊 eo7e777 75 727776 の 


of the Gershgorin disK theorem. 7 ん 7 Se7yo72 人 A7o72ov7c7 Ce7y77eO777. 
Exercise 23 states that the radius Of oz が se の 太 が 5 7es77 7 7 の 37. 


each Gershgorin disK could be changed 
to the sum of the absolute values of corresponding column entries (instead of row 
entries), excluding the diagonal entry, and the theorem above would still hold. 
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re7cz7yey う / 


10 


Suppose is a finmite-dimensional complex Vector space and 了 々 ( ぴ ). 


(a) Prove thatif7 キ ニー 了 then ア is diagonalizable. 

(b) Prove that if7*# ニア, then 7 is diagonalizable. 

(c) Give an example of an operator 了 と (で ?) such that 7 キー7 テ and7 ア is 
not diagonalizable. 


Suppose 了 と 々 ( ツ ) has a diagonal matrix 4 with respect to some basis 
of Provethatif ん FE,then ん appears on the diagonal of 4 precisely 
dim EE(A, 了 7) times. 


Suppose V is finite-dimensional and 了 と 々 ( ゆ ). Prove that 導 the operator 了 
is diagonalizable, then ソニ null 了 7 の ranee 了 7 


Suppose is finite-dimensional and7 と 々 (). Prove that the following 
are eduivalent. 

(&4) =null ア @range 了 ア 

(b) =null ア +range 了 7 

(c) null げ nranee ア =(0). 


Suppose V is a finite-dimensional complex Vector space and 7 と 々 ( ぴ ). 
Prove that 7 is diagonahizable if and only if 


=nul( ザ アー47) @range ザ ー ス の) 
for every 人 と C. 


Suppose 了 と (E?) and dim E(8.7) = 4. Prove that ア ー27or ア ー67is 
invertible. 


Suppose 7 と 々 ( ぴ ) is invertible. Prove that 
の Pc 
for every ル と Fwith 信 チ 0. 


Suppose V is finite-dimensional and 7 ん ( じ ). Let ん , ……, ん denote the 
distinct nonzero eigenvalues of 7. Prove that 


dim PE(A1,7) キ … + dim E( ん 4 ア ) < dimrange 7 


Suppose KA,7 (FE?) each have 2, 6, 7 as eigenvalues. Prove that there 
exists an invertible operator 5 と (FE?) such that R = 5~!75S. 


Find R,7 と /(F?) such that Rand ア each have 2, 6,7 as eigenvalues, and 
了 have no other eigenvalues, and there does not exist an invertble operator 
S と 々 (EE*) such that R = 5875. 


11 


12 


13 


14 


15 


16 


17 


18 
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Find 7 と (で ?) such that 6 and 7 are eigenvalues of and such that does 
not have a diagonal matrix with respect to any basis of で * 


Suppose 7 と 々 (で ?) is such that 6 and 7 are eigenvalues of 了 ア , Furthermore, 
suppose 7 does not have a diagonal matrix with respect to any basis of で 
Prove that there exists (2」,2。,Z。) C3 such that 


了 (Z],2 っ , 2Z5) 三 (6 8Z],7 + 8Z っ , 13 + 8z。). 


Suppose 4 is a diagonal matrix with distinct entries on the diagonal and 
is a matrix of the same size as 人 4. Show that 4B=pA4ifandonlyifpisa 
diagonal matrix. 


(a) Give an example of a finite-dimensional complex vector space and an 
operator 7 on that vector space such that 7^ is diagonalizable but 7 is 
not diagonalizable. 

(b) Suppose F = C, た is a positive integer, and 了 と 々 ( ぴ ) is invertble. 
Prove that 7 is diagonalizable if and only if 7* is diagonalizable. 


Suppose V is a finite-dimensional complex vector space, 7 と 々 ( ゆ ), and ヵ 

is the minimal polynomial of 了 . Prove that the following are equivalent. 

(a) 了 is diagonalizable. 

(b) There does not exist ル  C such that ヵ is a polynomial multiple of 
(<-2)^ 

(c) and its derivative / have no Zeros in common. 

(d① The greatest common 中 visor of ヵ and ア が is the constant polynomial 1. 


77,e g7eg7e57 CO772772077 の 7yZyO7 の / 7 の の 75 7e 7o77C po の yo777 7 の 
/27ges7 の ee7ee yzzC7, 777d7 777 の g7e oo/y7O7777 72777 の 7ey の げ 7. 77e 
4c777eg77 7go777777 7 の 7 の 7 の 77777 ゞ (/oo ん 7 7 の ) Cd72 9777C ん /y の e7e77727776 
77e 87e76S7 CO777777O72 77yO7 の / 7vO の の 7 の 727775。 7777O777 76 の 777775 7 
77O77777O72 の の O747 777e <e7 の Oy の / 妨 e po の 7 の 777g/5. 77745 7e eg47yg/e72ce の 7 (の ) 
g77 (⑦) の ove yos 万 27 ye Cg72 の 67e77777776 Ye777e7 了 7 の 72go7777Zg の /e 
7770o77 77Ow725 7 9 の oz77 7e <e7Oy の げ 万 


Suppose that 了 と 々 (V) is diagonalizable. Let , …, 和 ん, denote the distinct 
eigenvalues of 了 . Prove that a subspace U of is invariant under 7 if and 
only if there exist subspaces 7,… of V such that 人 ル し CE( ん 7) for 
each た and リ ニー リロ の 6…@ し し 


Suppose is finite-dimensional. Prove that 々 () has a basis consisting of 
diagonalizable operators. 


Suppose that 了 と 々 (P) is diagonalizable and is a subspace of that is 
invariant under 7. Prove that the quotient operator 7// is a diagonalizable 
operator on V/. 


77e 7 の 776777 67 の 7O7 了 / yy の e77769 7 万 e7c7Se づ 9 777 Sec7 の 7 う 4. 
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Prove or give a counterexample: TT 了 7 々 ( じ ) and there exists a subspace げ 
of that is invariant under 7 such that 7 and 了 /U are both diagonalizable, 
then 7 is diagonalizable. 

See 万 Ye7c7se 73 777 Sec77O77 う C / の 7 72 の 27/OgO74 977767776777 の の の 777 7 の 67- 


7772874747 777777C6S. 


Suppose V is finite-dimensional and 了 と 々 (). Prove that 了 js diagonaliz- 
able if and only if the dual operator 7” is diagonalizable. 


The 77ogccr se の ze7Ce っ , 15 defimed by 
。 = 0, チ =1, and 下 ニチ ーー ゥ 二子 。_」for カ >2. 


Define 7 と (RS) by TX の) ニ (あめ テ + の . 


(&) Show that 77(0,1) = (1) for each nonnegative integer 7. 
(b) Hind the eisenvalues of ア . 

(c) Find a basis of R< consisting of eigenvectors of 7 

(d) Use the solution to (c) to compute 77"(0,1). Conclude that 


計 誠 ( 人 ーー ビデ )| 


for each nonnegative integer 7. 
(e) Use (d) to conclude thatif 7 ヵ is a nonnegative integer, then the Hibonacci 
number 子 , is the integer that is closest to 


1 (^ + V5 ) 
y5\N 2 / 
gc7 7 な 9 7 の 772687Ye 77768e7 eve77 og7 77e 77g77 s7 の e の 7 太 e 767772777 
77 (の ) oey 7 の 7 /oo ん /7e g77 7776ge7 777e 777777 の 67 


1+ V5 


75 cg//cg 77e go/7e72 7 が の. 


Suppose 7 と ( げ ) and 4 is an か -by-7 matrix thatis the matrix of イア with 
respect to some basis of じ . Prove that if 


7 
4 ッ > 92 4 


for each / {1, …,7), then 7 is invertible. 


7775 ere7C7Se 57g76y 7 が 77e go774/ e7776 ゞ の げ 77e 7 の が 了 7e /47ge 
CO777 の 7@ 7 の 777e 77O7 の 26O767 e74776s, 770e77 了 75 Ve777 め /e. 


Suppose the definition ofthe Gershgorin disks is changed so thattheradius of 
the は disk is the sum of the absolute values of the entries in column (instead 
of row) た of 4, excluding the diagonal entry. Show that the Gershgorin disk 
theorem (5.67) still holds with this changsed definition. 
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う / Co7777777775 びり 67 の 7 の 7 ゞ 


5.71 definition: co777777777e 


e Two operators S and 7 on the same vector space co777777e 1 57 ニー7S. 


e Two square matrices 4 and of the same size co777777e if AP ニー PA. 


For example, ザ 了 1s an operator and ヵ , 9 ア (F), then p ず ) and 7(7) commute 
[see 5.17(b) |. 

As another example, if 7 is the identity operator on V then 7 commutes with 
every operator on / 


5.72 example: /g777g/ 7 が 7e7477777O72 の @7 の 7 の 7 CO77777476 


Suppose 77 is anonnegative integer. Let の (R^) denote the real vector space of 
polynomials (with real coefcients) in two real variables and of desree at most 77,。 
with the usual operations of addition and scalar multiplication of real-valued 
functions. Thus the elements of の ,(R2) are functionsp ヵ on RS of the form 


5.73 = 2 の 
7+ た く 77 
where the indices /and た take on all nonnegative integer values such that 7+ た く 77, 
each の の. と is in R, and 5 ん denotes the function on R< defined by (*, 7) ウ ダ 0 
Define operators D。,D, 々 (の ,(R う ) ) by 


D り ぁ ヵ = デニ の 。 力 が and 0 〉. Kg が こう 
リ + た ご 


where ヵ is asin 5.73. The operators り 。 and /, are called partal differentiation 
operators because each of these operators differentiates with respect to one of the 
variables while pretendine that the other variable is a constant. 

The operators り 。 and , commute because iS as in 5.73, then 


55) ルー 2 AWC ゲー ョ (DB)z 


7+ サ た く 77 


The equation り 。 り , = りり 。 on (R2^) ilustrates a more general result that 
the order of partial diffewentlatlon does not matter for nice functions. 


Commuting matrices are unusual. 
For example。 there are 214.358.881 1 pg77* の 7 77e 2- の y-2 7 が 7C65 772767 CO77- 
of by-2 matrices all of whose entries S7e7g77O77 We76 Cec ん eg の y の CO777 の 74767 
are integers in the interval [一 5,5]. Ony  / cove7 如 g7 oz の 67 多 609 7 如 eye 
about 0.39 of these pairs of matrices 7 が 5 の 7 777 が 77Ces Co77777e. 
commute. 


47 27358.887 (wc7 egg/5 115) 
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The nextresult shows that two operators commute if and only if their matrices 
(with respect to the same basis) commute. 


5.74 co77777277777g OD@7 の 7 の 7 CO77@5O77 7 の CO777777777775 777777C@y 


Suppose 5, 了 々 (P) and の 」,.…,6, 1S a basis of Then S and 了 commute 放 
and only if 7(S, (の 」,.…, の,) ) and 77 ( 了 ア , (の 」, …, の ,) ) commute. 


Proof Wehave 
5 and 了 7commute e つ 57= ェ ザ ア S 
< テ 77(57) = 77(7S) 
* っ 77(S5)777) = 77⑦)77(S) 
e う (65) and 7) commute, 


as desired. 


The next result shows that if two operators commute, then every eigensDace 
for one operator is invariant under the other operator. This result, which we will 
use several times, is one of the main reasons why a pair of commuting operators 
behaves better than a pair of operators that does not commute. 


5.75 6e7ge775 の Ce 75 777D77727 777 の 67- CO77777777777g の D6777 の 7 


Suppose 5, 7 々 () commute and ん F. Then E(A, 5) is invariant under 7. 


Proof Suppose EE( ん ,5). Then 
5(7?) = ニ (57)o = (75)o ニア (5o) ニ 了 (Ao) = AT7o. 


The equation above shows that 7o 6 E(A, 5). Thus E(A, 5) is invariant under 7 


Suppose we have two operators, each of which is diagonalizable. If we want 
to do computations involving both operators (for example, involving their sum), 
then we want the two operators to be diagonalizable by the same basis, which 
according to the next result is possible when the two operators commute. 


5.76 7777772726 の 745 の go77977z の 77 の で つつ co72772747277V77y 


Two diagonalizable operators on the same vector space have diagonal matrices 
with respect to the same basis if and only if the two operators commute. 


Proof Hirst suppose 5,7 (げじ ) have diagonal matrices with respect to the 
same basis. The product of two diagonal matrices of the same size is the diagonal 
matrix obtained by multiplying the corresponding elements of the two diagonals. 
Thus any two diagonal matrices of the same size commute. Thus 5 and 了 Tcommute, 
by 5.74. 
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To prove the implication in the other direction, now suppose that 5,7 と 々 (の) 
are diagonalizable operators that commute. Let A」,.…, denote the distinct 
eigenvalues of 5. Because 5 is diagonalizable, 5.55(c) shows that 


5.77 =E(A,5) @… @ E( ん 4, 5). 


For each た = 1,.…,77。 the subspace E(A。,5) is invariant under 7 (by 5.75). 
Because 7 is diagonalizable, 5.65 implies that 7 s) iS diagonalizable for 
each た . Hence for each = 1,.…, 如 , there is a basis of E(A,5) consisting of 
eigenvectors of 了 . Putting these bases together gives a basis of (because of 
5.77), with each Vector in this basis being an eisenvector of both S and 了 ア . Thus 5 
and7 both have diagonal matrices with respect to this basis, as desired. 


See Exerctise 2 for an extension of the result above to more than two operators. 
Suppose is a finite-dimensional nonzero complex vector space. Then every 
operator on " has an eigenvector (see 5.19). The next result shows that if two 
operators on commute, then there is a Vector mthat is an eigenvector for both 
operators (but the two commuting operators might not have a common eigenvalue). 
For an extension of the next result to more than two operators, see Exercise 9(a). 


5.78 co77777772 @7ge72V@C7O7 /27 CO777777777776 O の 67 の 7 の 7? 


Every pair of commuting operators on a fimite-dimensional nonzero complex 
Vector space has a common eigenvector. 


Proof Suppose V is a finite-dimensional nonzero complex vector space and 
5,7 々 ( ツ ) commute. Let 4 be an eisenvalue of 5 (③.19 tells us that 5 does 
indeed have an eisenvalue). Thus E(A,S) チ {0}. Also, E(A, 5) is inVariant 
under 7 (by 5.75). 

Thus (4) has an eigenvector (again using 5.19), which is an eigenVector 
for both 5 and 李 , completing the proof. 


5.79 example: Co77777 の 72 67g672VeC7O7 27 7777 の 7e7e77777O77 の の 67 の 7 の 7 ゞ 


Let の み ,(R2) be as in Example 5.72 and let り ,, り , と る (,(R2) ) be the 
commuting partial differentiation operators in that example. As you can verify, 0 
is the only eigenvalue of each of these operators. Also 


万 (0, り 。) = 1 7 : 0 っ の R 
た =0 


777 
E(0,P,) = 1 0 ny の R 
=0 


The intersection of these two eigenspaces is the set of common eigenvectors of 
the two operators. Because E(0, り 。) n E(0, 生 is the set of constant functions, 
we see that り 、 and り , indeed have a common eigenvector, as promised by 5.78. 
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The next result extends 5.47 (the existence of a basis that giVes an uDDer- 
triangular matrix) to two commuting OperatOrs. 


5.80 co77772777774g OD@7 の 7 の 7 ゞ の 7@ 777777777726O7457 ツ 77 の 67 77725777777Z の の /e 


Suppose V is a fite-dimensional complex Vector space and 5,7 are 


commuting operators on " Then there is a basis of with respect to which 
both 5 and 7 have upper-triangular matrices. 


Proof Let ヵ = dimV We will use induction on 7. The desired result holds if 
ヵ ニニ 1 because all 1-by-1 matrices are upper triangular. Now suppose 7 > 1 and 
the desired result holds for all complex Vector spaces whose dimension is ヵ ー 1. 
Let ?」be any common eigenvector of 5 and 了 (using 5.78). Hence 5o」 
SDan(?」) and 7?」 span(?」). Let W be a subspace of such that 
V = span(o」) @ Wi: 
see 2.33 for the existence of W. Define a hnear mapP: ソ っ WWby 
ア (2 の 」 の ) 三 の 
for eachz7 と Cand each WW. Define 呈 馬 々 (W) by 
So = (5o) and 7ro = P(77 の ) 


for each W. To apply our induction hypothesis to 5 and 7, we must frst show 
that these two operators on W commute. To do this, suppose o  W. Then there 
exists g 三 C such that 


(57)w 本 S(P(7o の )) ニー 5(7oo ー の ) 三 P(S(7ro 一 go ) ) = P((57) の ), 


where the last equality holds because o」 is an eigenvector of 5 and Po」= 0. 
Similarly, 

(5) = P(7S)@ の ). 
Because the operators 5 and 了 commute, the last two displayed equations show 
that (57)w 一 (75). Hence 5 and 了 commute. 

Thus we can use our induction hypothesis to state that there exists a basis 
の っ , …。 の, Of W such that S and 了 both have upper-triangular matrices with respect 
to this basis. The Hst o」,… の, 1S a basis of 

THF {2, ……, 妃 ), then there exist Z, ち , 三 で such that 


So = ニ み の 二 5 and 7 = 久本 77 
Because S and ア have upper-triangular matrices with respect to の っ ,……, の, We 


know that 5o。 三 span( の , …。 で) and Tp, span( の っ , ……,C。). Hence the equations 
above imply that 


Soz span( の 」,…, み ) and 7? SDan( の 1,.…, の ). 


Thus 5 and ア have upper-triangular matrices with respect to ?」 , …, の,, 8S desired. 


Exercise 9(b) extends the result above to more than two operators. 
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In general, it is not possible to determine the eigenvalues of the sum or product 
of two operators from the eigenvalues of the two operators. However, the next 
result shows that something nice happens when the two operators commute. 


5.81  e7ge7zv/7zey の 7 y/7777 972 7 の 7/C7 の / CO7777727777725 O の 677707? 


Suppose V is a fmite-dimensional complex Vector space and 5, 7 are commut- 
ing operators on じ Then 


e every eigenvalue ofS5+ ア is an eigenvalue of 5 plus an eigenvalue of 了 , 


e eVery eigenvalue of 57 is an eigenvalue of S times an eisgenvalue of 7 


Proof There is a basis of with respect to which both S and ア have upper- 
triangular matrices (by 5.80). With respect to that basis, 


27(5 + 了 ア ) = 77(5)+ 777) and が (57) = 7(5)77⑦), 


as stated in 3.3S and 3.43. 

The definition of matrix addition shows that each entry on the diagonal of 
27(5 + ア ) equals the sum of the corresponding entries on the diagonals of 7 (⑤) 
and 7(7). Similarly, because 7($) and 7 (7) are upper-triangular matrices, 
the definition of matrix multiplication shows that each entry on the diagonal of 
27(57) equals the product of the corresponding entries on the diagonals of 7 (5⑤) 
and 7⑦). Furthermore, 77(5 + 了 本) and 7(57) are upper-triangular matrices 
(see Exercise 2 in Section SB). 

Every entry on the diagonal of 7(S) is an eigenvalue of 5, and every entry 
on the diasonal of 7) is an eigenvalue of 7 (by 5.41). Every eigenvalue 
ofS5+ ア is on the diagonal of 77(5 + ず の ), and every eigenvalue of 57is on 
the diagonal of 77(57) (these assertions follow from 5.41). Putting all this 
together, we conclude that every eigenvalue of S+ 了 is an eigenvalue of S plus 
an eigenvalue of 了 , and every eigenvalue of S7 is an eigenvalue of 5 times an 
eigenvalue of 子 . 


re7c7yey うど 


1 Give an example of two commuting operators 5,7 on F* such that there 
is a subspace of F* that is invariant under S but not under 7 and there is a 
subspace of F* that is invariant under ア but not under 5. 


2 Suppose ど is a subset of ん ( じ ) and every element of と is diagonalizable. 
Prove that there exists a basis of 『 with respect to which every element of と 
has a diagonal matrix if and only 半 every pair of elements of @ commutes. 

7777y ere7C7Se er/7e77 の 7? う .76, 7 Co7257de7y 77e Cgse 777 77C7 と Co777777? 
の 7 YO @/e7767775. 万 7 7775 ere7C7S@, と 7 CO7772777 7 777477 の 67 の 7 @/67776775, 
g77 の のど 7 eVe7 の e 7 77777776 67. 
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Suppose 5,7 と 々 () are such that 5 アニ 7S. Suppose ヵ アア (E). 


(&) Prove that null ヵ (5) is invariant under 7 
(b) Prove that range ヵ (5) is invariant under 7. 


See う .79 7 娘 e の ec の 7 cgye 5 ニア | 


Prove or give a counterexample: T 4 is a diagonal matrix and pis an 
upper-triangular matrix of the same size as 人 A, then 4 and commute. 


Prove that a pair of operators on a fimite-dimensional vector spDace commute 
i and only 証 their dual operators commute. 


See 2.778 7 77e の e777777 の 7 の 7 77e の 447 の 7 77 の の 67 の 7 の た 


Suppose V is a finite-dimensional complex vector space and 5,7 々 ( ぴ ) 
commute. Prove that there exist , と C such that 


range(S5 一 み )+range ザ ー 47) チ 攻 


Suppose V is a complex vector space, 5 々 ( ぴ ) is diagonalhizable, and 
了 と (げじ) commutes with 5. Prove that there is a basis of such that 5 has 
a diagonal matrix with respect to this basis and 了 has an upper-triangular 
matrix with respect to this basis. 


Suppose 77 三 3in Bxample 5.72 and り 。, り , are the commuting partial 
differentiation operators on 包 (R^) from that example. Find a basis of 
み (R2) with respect to which り 。 and り , each have an upper-triangular 
matTiX. 


Suppose is a finite-dimensional nonzero complex Vector SsDace. SUDDOSe 
that どこ の (V) is such that 5 and7 commute for all 5.7 のど . 


(a) Prove that there is a vector in that is an eigenvector for every element 
of の . 

(b) Prove that there is a basis of V with respect to which every element of 
と has an upper-triangular matrix. 


7777y ere7C7se 6X7e7 の y う .7@ 7 の う .80, 77c7 co72y7e7 77e cgye 777 77c7 ど 
co72727775 の 7 の 6/e7767775. 万 O7 75 eXe7C7S6, ど 7 CO7779772 972Y 7277777 の e7 の が 
@/e7776777$, の 72 ど 7 の 6Ve7 e 77 772777277e ye7. 


Give an example of two commuting operators 5, 了 on a finite-dimensional 
real vector space such that 5+ ア has a eisenvalue that does not equal an 
eieenvalue of S plus an eigenvalue of 了 and 57 has a eigenvalue that does 
not equal an eigenvalue of 5 times an eigenvalue of ア 


7775 ere7C75e Osy 娘 27 う .67 2ey 7O7 7O/ O74 7eg/ vec7 の 7 5dC6S. 


Chapter 6 匠 hd 


In making the definition of a Vector space, we generalized the linear structure 
(addition and scalar multiplication) of R2 and R? We ignored geometric features 
such as the notions of length and angle. These ideas are embedded in the concept 
of inner products, which we will investigate in this chapter. 

Every inner product induces a norm, which you can think of as a length. 
This norm satisfies key properties such as the Pythagorean theorem, the triangle 
inequality, the parallelogram equality, and the Cauchy-Schwarz inequality. 

The notion of perpendicular Vectors in Euclidean geometry gets renamed to 
orthogonal vectors in the context of an inner product space. We will see that 
orthonormal bases are tremendously useful in inner product spaces. The Gram- 
Schmidt procedure constructs such bases. This chapter will conclude by putting 
together these tools to solve minimization problems. 


7 の 772g 5577777 の 77O77S 727 7775 CZ の 7e チ 


e F denotes R or C. 
e and W denote vector spaces OoVer F. 


VS OO 』0OJ19d AA9JHEMA 


77e eo7ge gp 477 記 22 の pi 0 の De pey22 We 
/g77es Sy/esy7e7 (767 人 イー769/) gs 7e 77Pe7S7y S 77 7 の 7706777777Cy 7 の eyyO7 Sy ル es7e7 ゞ 
の /7cd77 の 775 772C74 の e 77e 7757 45e の 7 77e WO77 722 が 7 7 777777e777777CS. 
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64 777e7 7 の oc75 7 の /WO7777? 


77777e7 /7 の 7C な が 


To motivate the concept of inner product, 
think of vectors in R< and R3? as arrows (2, の 
with initial point at the origin. The length の 

of avector oin R< or R? is called the 

7 の 7777 Of の and is denoted by |gl. Thus 
foro = (g,5) と RS we have 


Ilgll = Vg< + の ゲ . 


Similarly, 下 = (2, ち c) と RY then ll| = V22+ の Tc7. 
Even though we cannot draw pictures in higher dimensions, the generalization 
to R" js easy: we define the norm of ァ ニ = (r」,.…,,) NR7 by 


777s vec7o7 の gy 7 の 7777 Vg2 の. 


計 2 2 
II = YY イキ … 二 テテ . 


The norm is not hnear on R" To inject Hinearity into the discussion, we 
introduce the dot product. 


6.1 definition: の 67 p7o7/c7 


For xy R the do7 7ogzzc7 Of > and 7, denoted by *・, is defmed by 


*・ リ ニル 1 の キー 二宮 


where = (Y],…。 そ ,) and 7 ニ (の ,… っ >) 


1 万 
The dot product of two 9 Im 民 が ye 7 ん の 7 Vec7O7 5 の /O777 7797eg の 7 
is a number, not a Vector. Notice that の 7 gs g7 grow 放 en ll sog/7 pe 


2 
* ャ II に forallrERP" Furthermore, 訪 e の 7e/e 76 77e7 7 が e の 57gce 廊 o77 
the dotproductonR" hasthe following 訪 eorzeg 刀 7o 太 epo が 7 

DTODertes. 


e ーッ メジ Oforallz 三 RT 

es メー0 症 andonlyifx=0. 

e ForyR" fixed,the mapfromRtoRthatsends*R" to ァ ・yis Hnear. 
ゃ テリー ニ 7・Yforallry 選 RT 


An inner product is a generalization of the dot product. At this point you may 
be tempted to guess that an inner product is defined by abstracting the properties 
of the dot product discussed in the last paragraph. For real vector spaces, that 
gueSss is correct. However, so that we can make a definition that will be useful 
for both real and complex vector spaces, we need to examine the complex case 
before making the definition. 
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Recall thatif え 4 えー ニ gz+ の , where 7, ち R, then 
e the absolute value of A, denoted by | ん |, is defined by | ん | = V22+ の 8 
e the complex conjugate of A, denoted by A, is defined by え ニ gー: 
e AZ ニ AA. 


See Chapter 4 for the definitions and the basic properties of the absolute Value 
and complex conjugate. 
For z = (Z,…,Z。) と で we define the norm ofzby 


lzl = VIziP+…+ ォ kg. 


The absolute Values are needed because we want |I| to be a nonnegative number. 
Note that 
7 = 所 オー オス 

We want to think of HzI" as the inner product of z with itself, as we did 
in R" The equation above thus suggests that the inner product of the Vector 
の 三 (6 の,…, の) で C" with z should equal 

の 12Z] 二 … 十 0 る 

Tf the roles of the の and z were interchaneed, the expression above would be 
replaced with its complex conjugate. Thus we should expect that the inner product 
of zo with z equals the complex conjugate of the inner product of z with の. With 
that motivation, We are now ready to defime an inner product on which may be 


a real or a complex vector SDace. 
One comment about the notation used in the next definition: 


e For 人 ん C,the notation ル > 0means ん is real and nonnegative. 


6.2 definition: 777267 7 の 977c7 


An 772e7 /7 の gzc7 on V is a function that takes each ordered pair ( ヵ ,?) of 
elements of to a number ( ヵ 4, の ) ビ F and has the following properties. 
pOSitivity 

〈《⑦, の ) と 0forallo と 


defimiteness 
(《@ の の) ニ 0 放 andonlyifo=0. 


additivity in first slot 
(2 寺 の , の ⑦) 三 (72, の ) 填 (⑦, の) for all 7 の の ヒビ 


homogeneity in first slot 
(Az, の ) 三 A( ヵ の ) for allA Fandallzo の と 


conjugate symmmetrY 
7, の) 三 (の ⑦,7) for all の 
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Every real number equals its complex の es 4822 oo: 


conjugate. Thus if we are dealing with pyogc7s gs G の ove, 7 7 の が” DS7C7s が 
areal vector space, theninthelastcon- zz 。 の 訪 77 が 7o7 太 q7 7eg/77es 0O77O- 


dition above we can dispense with the zeze の 娘娘 e seco7 s/o7 7s7egg o/ 
complex conjugate and simply statethat 廊 e 記 ss/or 
(7。 の ) ニ (の ⑦,7) for all 7 の 


6.3 example: 777767 7 の 7C な な 


(a) The Pzzc/ が 7eg7 77767 の 7 の gzc7 On F" js defined by 
(の …。 の (2 … ッ 2)) の 争 キー オキ の る 


for all (の 0],…, の), (2 …Z。) FT 


(b) Tc], …, care positive numbers, then an inner product can be defined on F" 
by 
((G の 1,…。 の) (2 … ッ 2 ) 三 C1 の 1 婦 キー OZ 


for all (の 0],…, の), (2 …Z。) FT 


(c) Aninner product can be defined on the Vector space of continuous real-valued 
functions on the interval [一 1,1] by 


(0.8/ 己 較 7 


for all た continuous real-valued functions on [一 1, 1]. 


(d) An inner product can be defined on ア (R) by 


1 
ゅ の =pO90+| pg 


for all ヵ ,7 と ア (R). 
(e) An inner product can be defined on ア (R) by 


(⑰, 9) = 「 が ()9(Y)6 gd 


for all ヵ 7 ヒア (R). 


6.4 definition: 7767 7 の の 7/C7 ? の 9C@6 


An 7 が 67 7 の gzc7 PCe 1S a Vector space V along with an inner product on 


The most important example of an inner product spaceis FE” with the Buclidean 
inner product given by (a) in the example above. When F" is referred to as an 
inner product space, you should assume that the inner product is the Bucldean 
inner product unless explicitly told otherwise. 


Section 6A Inner Products and Norms 185 


So that we do not have to keep repeating the hypothesis that and W are inner 
product spaces, we make the following assumption. 


For the rest of this chapter and the next chapter, V and W denote inner product 
SDaceS OVer F. 


Note the slight abuse of language here. An inner product space iS a Vector 
Space along with an inner product on that vector space. When we say that a vector 
space V is an inner product space, We are also thinking that an inner product on 
Y is lurking nearby or is clear from the context (or is the Euclidean inner product 
if the Vector space is F"). 


6.6 4y7c /7O/6777e ゞ の 72 77777677 の 7 の 7/C7 


(a) For each fixed? the function that takes 7 三 V to (の) 1S a Hinear 
map from V to F. 


(b) (0,?) = 0 for everyo と 
(c) (?@, 0) = 0 for everyo と 


(④⑰ (24. の の ) 三 (7 の) 填 (77. の ) for all の の 手 


(e) (7, Ao) = A⑰, の ) for al 和え Fand allo と V ど 


Proof 
(a) Foro と the Hinearity ofz 中 (zz, の ) follows from the conditions of additivity 
and homogeneity in the frst slot in the definition of an inner product. 


(b) Every Hinear map takes 0 to 0. Thus (b) follows from (a). 


(c) fo と V (hen the conjugate symmetry property in the definition of an inner 
product and (b) show that の, 0) = (0. の ) ニ 0=0. 


(Suppose 6 の と Then 


(2, の 十 の ) 三 《⑦ 十 の , 7) 
三 (⑦, 7 の) 十 (の , 7) 
三 (の ,7) 十 (の, 77) 


三 (2, の) 十 (4, の). 


(e) Suppose 人 Fando と V Then 
( ヵ 。 Ao の ) = (4 の め 
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WO7772y 


Our motivation for defining inner products came initially from the norms of 
vectors on R< and R* Now we see that each inner product determines a norm. 


Foro と ゆば the zo777 of ?, denoted by |gl, is defined by 


Il ニ (@, の ). 


6.8 example: 77O7777 ゞ 


(a) Jf (2」,…,Z。) と F" (with the Euclidean inner producb), then 


NZ,… っ 2 IEiIn キー ナビ . 


(b) For in the Vector space of continuous real-valued functions on [1,1] and 
with inner product given as in 6.3(c), we have 


1 
ーー 2 
中 = 7 
6.9 4y7c /7O/6777ey の / 777e 7707777 


Supposeo 三 


(a) Il =0ifandonly 導 o=0. 
(b) IAgl = IAllgllfor allAeE. 


Proof 
(a) The desired result holds because の,o) = 0ifand only fo=0. 


(b) Suppose AE F. Then 
IAol* = (Ao 4 の ) 
三 人 ル (?, の) 
三 ん A( の の ) 
= AI lg に 
Taking square roots now gives the desired equality. 


The proof of (b) in the result above illustrates a general principle: working 
with norms squared is usually easier than working directly with norms. 
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Now we come to a crucial definition. 


6.10 definition: o7777ogo7z/ 


Two vectors ,, の Vare called o777ogo7g/ if (4 の) 三 0. 


In the definition above, the order of 
the two Vectors does not matter, because 
の) =0 評 andony ぜ の ⑦ め 三 0.Im- 誌 gg/e の 
stead of saying zz and?oare orthogonal, 
sometimes We say 7 1S orthogonal to の . 

Exercise 15 asks you to prove that 半 の are nonZero Vectors in R< then 


77,e yo77 o77770g の 727 co7726 ゞ 7 の 772 77e 
C7ee ん yo7 o77770g077 の 5, 777C77 7776779 


( ヵ の ) lgllcos 6 


where の is the angle between 7 ando(thinking of zando as arrows with initial 
point at the orisin). Thus two nonzero vectors in R2 are orthogonal (with respect 
to the Euclidean inner product) if and only if the cosine of the angle between 
them is 0, which happens and only if the vectors are perpendicular in the usual 
sense of plane geometry. Thus you can think of the word o777ogo7g/ as a fancy 
word meaning pe7 の e77c74727. 

We begin our study of orthogonalhity with an easy result. 


.11 or77ogo7zg777 が の 777 0 


(a) 0 is orthogonal to every Vector in 


(b) 0 is the only vector in that is orthogonal to itself. 


Proof 
(a) Recall that 6.6(b) states that (0,o) = 0 for everyo と 


(b) Ifo と and (の ,?) = 0, then = 0 (by definition of inner product). 


For the special case = RS the next theorem was known over 3,500 years ago 
in Babylonia and then rediscovered and proved over 2,S00 years ago in Greece. 
Of course, the proof below is not the original proof. 


6.12 ygo7eg72 77eO76777 


Suppose 7。 の IFzandoare orthogonal, then 


2 2 の 
lz+ の | = に + ll に 


Proof Suppose (4, の ) = 0. Then 
Iz 二 ^ ニ (2 二 の 。27 二 の ) 
三 (%.7) 圭 ⑰。 の ) (の 7) 寺 ⑰, の) 


2 2 
= に + ll に 
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Suppose 4 の witho チ 0. We would like to write z as a scalar multple 
of?plus a Vector の orthogonal to ?, as suggested in the picture here. 


47 の 7 の go77 の eco777 の の 5777 の 77・ 
7 XP76yye ゞ の SCg77 7277777 の 7e の 7 の 7745 の vec7O7 07777OgO7797 7 の の . 


To discover how to write z as a scalar multple of?plus a Vector orthogonal 
too,letcEF denote a scalar. Then 


7 三 C の 十 ( ケ 一 C の ). 
Thus we need to choose c so that ois orthogonal to (一 co). Hence we want 
0=(⑭ーco, の =. の 一 cdlgl に た 


The equation above shows that we should choose c to be 〈 ヵ の) /gll に Making this 
choice of c, We can Write 


〈⑰9) ( 2/ ) 
7 三 の 十 [ 一 ? |. 
lgl* lgl* 
As you should verify, the equation displayed above explicitly writes 4 as a scalar 


multiple ofoplus a vector orthogonal to o. Thus we have proved the following 
key result. 


6.13 2g7, o7777Ogo72g7 の eco777 の の 5777O77 


(2. の) 


ll 


Suppose 6, の 三 witho チ 0.Setc = 


77 三 Co 二 の and (の の )=0. 


The orthogonal decomposition 6.13 will be used in the proof of the Cauchy- 
Schwarz inequality, which is our next result and is one of the most important 
inequalities in mathematics. 
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6.14 Cgzc/yーSc7 が 77< 776 の 7977 


Suppose 7 の 三 Then 


Kz9)| < ll ll. 


This inequality is an equality 証 and only if one of oiS a scalar multiple of 
the other. 


Proof 


せ ? ニ = 0, then both sides of the desired inequality equal 0. Thus we can 


assume that 子 0. Consider the orthogonal decomposition 


ー (4 の ) 
_ lgl2 


given by 6.13, where の is orthogonal to の . 


(4 の) 
の P4 


ME | 


2 
(4 の )| 
の 4 


2 
の )| 
の 4 


7 
の 


6.15 > 


の | 


By the Pythagorean theorem, 


2 
| + le 
+ leely* 


Multiplying both sides of this inequality by gl and then taking square roots 


gives the desired inequality. 

The proof in the paragraph above 
shows that the Cauchy-Schwarz inequal- 
ity is an equality if and only if 6.1S is 
an equality. This happens if and only 
fp= ニ 0.But の =0 ぜ andonlyifz 
is a multiple of? (see 6.13). Thus the 
Cauchy-Schwarz inequalhty is an equal- 
ity ifand only fis ascalar multiple ofo 
or の is a scalar multiple of ヵ (or both: the 
phrasing has been chosen to cover cases 
in which either zz oroeduals 0). 


人 Ag777-/o7y Cg が yy (778 の -765Z) 
7oveg 6.76(@) 77 7627. 7 7659 
Cgzc7y * 574e777 V77o7 7777 ん ovy ん y 
(760 グ 4-/88 の ) 7oveg 777e67/ 77769747/- 
777ey 77e 77e o7e 777 6.76( の . 4 ww 
gecgey /47e7, 97777727 gzycove77e ゞ の y 
万 e77777777 Sg7 く (76 ラー/927) g7- 
7 の 76 777O7@ 07767277O77 7 の /eg 7 の 77e 
77776 の 7 7 が 5 72697777 の / 


6.16 example: Cgzc7yー5c7y の 7< 7726974777 


TE リッ 7 ビ R, then 


631./| 本 や 圭 5 < ( 字 + 


2 
7 


… キ (9 キー オタ) 


as follows from applying the Cauchy-Schwarz inequality to the Vectors 
(っ) (サーッ の) NR using the usual Buclidean inner product. 


190 Chapter6 InnerProduct Spaces 


(b) せ 記 e are continuous real-valued functions on [1, 1], then 


1 2 1 1 
[ 誠 s(「 の (g) 
as follows from applying the Cauchy-Schwarz inequalty to Example 6.3(c). 


The next result, called the triangle inequality, の 
has the geometric interpretation that the length 
of each side of a triangle is less than the sum of 
the lengths of the other two sides. 

Note that the triangle inequality implies that 
the shortest polygonal path between two points is 
a single hine segment (a polygonal path consists 
of jine segments). 


7 妨 7 7772787e, 7e /e7g77 の が 
7 十 の 5 7eys 万 77 7e /e7g77 
の 7 775 77e /e7g77 の 7 の 


6.17 777g7zg/e 77e9 の 7 が 


Suppose 4。 の  V Then 


lz+| < 中 +_. 


This inequality is an equality if and only if one of の is a nonnegative real 
multiple of the other. 


Proof Wehave 
Il ^ ニ ( み の) 
三 (4 2) 十 の, の ) 圭 (4. の ) 十 (の , の ) 
三 (477) の. の ) (5 の) 二 ( あ の 


= ll7 + lgl+ 2 Re(7。 の) 


6.18 < + 7+2| の の | 
6.19 < + gl + 2|| lgl 
2 
= (ll + lglD” 


where 6.19 follows from the Cauchy-Schwarz inequality (6.14). Taking square 
roots of both sides of the inequality above gives the desired inequality. 

The proof above shows that the triangle inequality is an equality if and only if 
we have equality in 6.18 and 6.19. Thus we have equality in the triangle inequality 
if and only 


6.20 〈⑫ ヵ 6) ニ ll. 


Hf one of 4 の is a nonnegative real multple of the other, then 6.20 holds. Con- 
Versely。 suppose 6.20 holds. Then the condition for equality in the Cauchy- 
Schwarz inedquality (6.14) implies that one of の is a scalar multiple of the other. 
This scalar must be a nonnegative real number, by 6.20, completing the proof. 


For the reverse triangle inequality, see Exercise 20. 


Section 6A Inner Products and Norms 191 


The next result is called the parallel- 
ogram eduality because of its geomeftric 
interpretation: in every parallelogram, the 
sum of the squares of the lengths of the 
diagonals equals the sum of the squares of 
the lengths of the four sides. Note that the 
proof here is more straightforwardthan 77egzgog/s の が 太 な pg7g77e/Og777 
the usual proof in Euclidean geometry. の 6 7 十 の 7 の 7ー の 


.21 /g7g//e/2g7777 6974 の 777y 


Suppose 4, の 6 三 V Then 


lz+gl^+l み 一 力 =2(|*+ 7). 


Proof Wehave 
凡才 ^+ llz 一 7 ニ (2 の 72 二 の ) 二 (2 一 の 7 一 の ) 


= + (4 の ) (の 7 


+ |+ gl デー の) 一 (の の 
= 2(| に + lgl7), 


as desired. 


Ye7c7yey 64A 


1 Prove or give a counterexample: If o」,.…,o, then 


2 Suppose S と 々 ( ゆ ). Define (1 by 
(7 の 三 (57。 5 の ) 
for all と Show that (,)1 1S an inner product on Vand onlyiSis 
1njectiVe. 


3 (a) Show that the function taking an ordered pair ((Y」,?。), (7」, ゆ の) ) Of 
elements of RS to | Io っ | iS not an inner product on R^ 

(b) Show that the function taking an ordered pair ((X」,Y っ , Y), ( り ], 7 73)) 
of elements of R? to ry」 + Ya 1S not an inner product on R* 


4 Suppose 7 と 々 ( ゆ ) is such that I7oll < gl for every o と V Prove that 
ーッ 27js 1njectiVe. 
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Suppose is a real inner product SDace. 


(a) Show that (+ の 7 一?) 三川 7ー lgl7 for every oo と 

(b) Show that if ヵ , の と have the same norm, then 7 の is orthogonal to 
ケー の . 

(c) Use (b) to show that the diagonals of a rhombus are perpendicular to 
each other. 


Suppose 6 V Prove that (の) ニ 0 | 邊 SIlz+gglforallzEF. 


Suppose 6 ビ ソ Prove that 2 + 5 = IPz + go for all45R 下 and 
only | = lgl. 


Suppose 5cx。7 Rand22+ す だ + の + ォ デ + ォ 7 が < 1. Prove that 
7 十 り +c 二 4y+9y く 10. 


Suppose ヵ , の and | = gl = 1 and (の ) = 1. Prove that 7 ニ の . 


Suppose ヵ ,o の ビリ and ll < 1 and |lgll < 1. Prove that 


Y1 一 叫 ^V1 lglF<1 Ko の | 


Find vectors ,o  R< such that 7 is a scalar multiple of (1.3),o is orthog- 
onal to (1,3), and (1,2) ニル 4+ の . 


SuDDOse の , ち ,C,9 are DOSitiVe numbers. 
1 


1 1 1 
(8) Prove that @+5+c す の (キテ キー キー) > 16. 
7 ちり oc g 


(b) For which positive numbers 7, ち , c, is the inequality above an equality? 


Show that the square of an average is less than or equal to the average of the 


squares. More precisely, show that 4, .…, 4 R, then the square of the 


average Of 7」,…。。 1S less than or equal to the average of 2 用 …。7 た 


Supposeo ando 子 0. Prove that o/|gl| is the unique closest element on 
the unit sphere of too. More precisely, prove thatifz andl = 1, 
then 


の 
ト - 語 | se- 品 
ll 
with equality only 導 7 ニッ /|gl. 
Suppose 74, の are nonZero vectors in R< Prove that 
( ヵ , の ) = lgll cos め 


where 9 is the angle between z ando(thinking of z andoas arrows with 
initial point at the origin). 


万 7 ye 77e /2w の 7 coOs776y 77 77e 772767e /277776 の の y 7 の の 72 の 7 で. 


16 


17 


18 


19 


20 


21 


22 


23 
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The angle between two Vectors (thought of as arrows with initial point at 
the origin) in R< or RY can be defined geometrically. However, geometry is 
not as clearin R" for ヵ > 3. Thus the angle between two nonZero Vectors 
* ァ り 三 R" is defined to be 


(Y,) 
OS 
II 


where the motivation for this definition comes from Exercise 15. Explain 
why the Cauchy-Schwarz inequality is needed to show that this definition 
makes sense. 


Prove that 


7 2 7 7 に 
< (る 
た =1 を =1 ご) た 
for all real numbers 2],…, and ち ,… 


(&) Suppose が [1, co) つ [0, oo) is continuous. Show that 


(| の < ey な 


(b) For which continuous functions : [1, oo) [0, co) is the inequahty in 
(a) an equality with both sides finite? 


Suppose の …。 の, 1 a basis of and ア 7 と (の). Prove that if ん is an 
eigenvalue of 了 了 , then 


AP s 2 2 1I27⑦), 放 


=1k ニ 1 


where 77 (7) 1 denotes the entry in row column た of the matrix of イア with 
respect to the basis の 」, …, の,. 


Prove that if の と then | Il - | | < 一 川 . 


77e 7zeg の 7 の の ove 7 cg//eg 77e 7epe7ye 7777257e 772677427 が の. の 7 77e 
7eVe7Se 777 の 767e 7 の 777y 7e7 V = C, see 太 Ye7c7se 2 7 Cd/7e7 


Suppose 7 の are such that 
ll =3, Hz+ 引 三 4 llz 一 引 三 6. 
What number does lgl edual? 
Show that if ヵ ,o と then 
lz+gllg 一 | <| 着 に + lg に 


Suppose ?」, …, の, Vare such that lloull < 1 for each た = 1,.…, 罰 . Show 
that there exist 7」,.…, の 。 所 (1, 一 1) such that 


Id の 7 キー オ の の 誕 S 77. 
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Prove or give a counterexample: If | is the norm associated with an inner 
product on RS then there exists (, り ) 三 R2<such that |( ァ , の ) 川 maxtll, |) 


Suppose ヵ > 0. Prove that there is an inner product on R< such that the 
associated norm is given by 


I(e の Il=(P+ 了 の) 7 
for all (y,) と R2 if and only 王 ヵ = 2. 
Suppose V is a real inner product space. Prove that 


の クーlz 一 の | 
6 4 


for all oo と 
Suppose V is a complex inner product space. Prove that 


有 』 了 < ウッ 志 2・ 
Il+ 配 ーー 一 本 に 二 +727ー | 一 2 の 7 


(の) ニ ィ 


for all oo と 
A norm on a vector space is a function 
けっ [O,oo) 


such that | = 0ifand only ifz = 0, | = |elll forallz Fandall 
z 三品 , and |lz 二 本 < | 証 + gl for all zo  . Prove that a norm satisfying 
the parallelogram equality comes from an inner product (in other words, 
show that if|・| is a norm on satisfying the parallelogram equality, then 
there is an inner product (-,・) on 7 such that | = (の 72 for allz). 


Suppose 尼 ,…, し , are inner product spaces. Show that the equation 
(GO) (の 1 …) の 。) ) 三 (4 の 7) キー (4 の) 


defines an inner product on メー メア 


7 77e eX の 7ey57 の 7 の ove O77 77e 77g777 7 egc7 た 三 1,.…,77, 妨 e 7767 7 の d7zc7 
(7。 の k) の e74O7ey 77e 777267 /7 の gc7 7 gc7 の 7 が e Spgcey U,…, レ , 77 の Y 
ve 9 の 7 ガ e7e777 7727767 7 の 97C7 6V677 万 の 4g7 777e Sd776 7707777 の 77 7S 74569 7e7e. 


Suppose is a real inner product space. For 7。 の , の 三 define 
(2 十 7 の , の 十 克 )C 三 (2. の) 十 (の ) 十 (( の , の ⑦) 一 (4, ))7. 


(a) Show that(。)c makes VC into a complex inner product sDace. 
(b) Show that if othen 


B の 4 2 の 
(〈⑰, の Cc ニ ( め の ) and | み +7 太 | = 叫 に 7+ lg に 


See 万 Ye7c7Se ざ 77 5ec7 の 7 7 / め 7 77e de7777777O7 の 7 77e co7 の /er7cg77O77 Vc. 
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Suppose 7 の, の Prove that 


1 > ll ゅ 一 如 ^+ll ゅ 一 7 lp 一 | に 
le- 3@+ の = っ ーーー 

Suppose that 万 is a subset of " with the property that ヵ ,o Eimplies 

ッ (7 +?) E. Let ゅ と Show that there is at most one point in 万 that is 


closest to rp. In other words, show that there is at most one 7 と such that 


lo 一 引 ミ le 一列 
for allr と E. 


Suppose /, g are differentiable functions from R toR" 
(a) Show that 


(の ,g⑥) = げ の ,g の )+ 7 の ,g⑰). 
(b) Suppose c is a positiVe number and | 7(⑰| = c for every 7 e R. Show 
that (が (⑰, 7(⑰ ) = 0 for every7 E R. 
(c) Interpret the result in (b) geometrically in terms of the tangent vector to 
a curve lying on a sphere in R" centered at the origin. 


4 7zc7 が oz R っ RP7 7s cg//eg が 7e777 の の 7e が 娘 e7e er757 の 67e777 の の /e 
が 7c が o75 方,…。 万 太 o72 R 7o R yo7 万 の 7 (の = ニ (方 の ,…, 廊 0) 7 eg 
# R. 刀 77 が e777o7e, 7 ego7 た R, 7 が e de7zvg7 が ve が (の と R" 5 の e 訪 ze の か 


げ (⑰ デ ( 片 (の, 電信 万 ⑰). 


Use inner products to prove Apollonius's identity: In a triangle with sides of 
length 2, ち , and c, let7 be the length of the line segment from the midpoint 
of the side of length c to the opposite vertex. Then 


の 2+ が ゲニ ッ ピ + 2 
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35 Hix apositive integer 7. The gp/c7277 Ap of a twice differentiable real- 
valued function ヵ on R" is the function on R" defined by 
9“ ヵ 9“ ヵ 


次 が ここ と . 
り az 「 ~ 2 


The function り is called 77o7zc 下 Ap = 0. 


A ヵ o/yzo77727 on R" is a hinear combination (with coefhcients in R) of 
functions of the form 9 … ィ アッ where 7 の,…, 7 Te nOnnegatiVe integeTs. 


Suppose 7 1S a Dolynomial on R" Prove that there exists a harmonic 
polynomial ヵ on R" such that p(*) = 7( 々 ) for every yR" with ll = 1. 

77e oz の 7 の o77 777 の 777C 77477C7O77y 77027 YO 7766 の 77 7775 ere7C7ye 7y 
27 が 5 9 727777O77C 47277 の 7 R" 7 の 7(Y) = 0 ん 7g7 ァ ER" 7 

lrl = 1, 太 ez カ =0. 

万 7 4 7egyo7g の /e geyy 75 万 7 娘 e es77e の 777772O777C の の の 77 の 7777 5 の 77e 
zz9+(1 一 有 HI)7/67 yo7e Po/y72o77727 7oye 放 g7 が e7e 5 7y72O7 が 7 
ozR7 sc 太 d79 キ (1 一 |)7 5 7777O7C の の 6 万 728 72 Pe77O7 7 oO7 

@ 7777/e ec7 の 7 SDCe クツ 


77 = A((1 一 HI の 


g77 777e72 y77OW72g 7707 7 5 77eC7ZVe 74 の 7e72Ce ゞ 77776C76. 


Tn realms of numbers, where the secrets lie, 

A noble truth emerees from the deep, 

Cauchy and Schwarz, their wisdom they apply, 
An inequality for all to keep. 


TWo Vectors, by this bond, are intertwined, 
As inner products weave a gilded thread, 
Their magnitude, by providence, confined, 
A bound to which their destiny is wed. 


Though shadows fall, and twilight dims the day, 
This inequalhty will stand the test, 

TO guide us in our quest, to hight the way, 

And in its truth, our understanding rest. 


So sing, ye muses, Of this noble feat。 
Cauchy-Schwarz, the bound that none can beat. 


ーwritten by ChatGPT with input 2 ん espe7e472 SO77467 の 7 CC7yーSc7p の 7 7776 の 2977 
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6/ の 7 万 277O777727 Pyey 


77o7O7777 の 7 7575 7 の 7e 7777ー5c7777 の 7 7oceg の 7e 


6.22 definition: o7 娘 o7o77726/ 


e Alist of vectors is called o77 娘 o7o7777/ if each vector in the list has norm 1 
and is orthogonal to all the other vectors in the jist. 


e jn other words, a Hst e」 , .…, 6 Of vectors in is orthonormal 


1 放 7/ ニ ん 


0 。 ザ / 了 ん 


for all 族 た 1, …,). 


6.23 example: or77o7zO7777/ 7y7y 


(a) The standard basis of F" is an orthonormal list. 

1 1 1 _ 1 1 1 5 
(b) ( 7 ( 7 0) is an orthonormal list in F* 

ユキ オー エル) イー 1 エル ユー ユ ーー タ ) ュ ュ エ ュー 3 
(で ( っ 還 ・ 0 っ Js an orthonormal list in F* 


(d Suppose 7 is a positive integer. Then, as Bxercise 4 asks you to verify, 


1 cosy CoOs2r COS7Y SinY Sin 2 Sin 7 
ーー ? 5 に 】 > う PE 
V2 元 V vV 元 V 宛  Y 宛 v 冗 V 宛 


is an orthonormal list of Vectors in C[ 一 宛 , 7], the Vector space of continuous 
real-valued functions on [一 宛 , 7] with inner product 


び の =| 7 


The orthonormal list above is often used for modeling periodic phenomena, 
Such as tides. 


(e) Suppose we make の (R) into an inner product space using the inner product 
given by 


ゅ の =| 


for all ヵ 7 め (R). The standard basis 1,, 2 of ツ 。 (R) is not an orthonor- 
mal list because the vectors in that Hist do not have norm 1. Dividing each 


Vector by its norm gives the Hist 1 /2. 3/2x, 5/2x2 in which each vector 
has norm 1, and the second vector is orthogonal to the first and third vectors. 
However, the first and third vectors are not orthogonal. Thus this is not an 
orthonormal list. Soon we will see how to construct an orthonormal list from 
the standard basis 1,, *^ (see Example 6.34). 
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Orthonormal Hists are particularly easy to work with, as illustrated by the next 
result. 


6.24 797777 の 7 972 7777O7777774/ /77767 CO777 の 77277777 


SupDOSe @], …, 6 1S an Orthonormal list of vectors in Then 


la オー… キ の | モビ +…+ la 記 


for all 2], .…, 4 F. 


Proof Because each e, has norm 1, this follows from repeated applications of 
the Pythagorean theorem (6.12). 


The result above has the following important corollary. 


6.25 o7 娘 272O7777g/ /7575 76 /7776 の 77 7 の 6 の 67476777 
Every orthonormal Hist of vectors is linearly independent. 


Proof Suppose e],…, 6 1S an orthonormal list of vectors in and g」,… 2 の,。 
are such that 


6 生 二 … オ の の 三 0. 
Then 2 ド +…ー+ に 0 (by 6.24), which means that all the z.'s are 0. Thus 
っ 6。 1 Hinearly independent. 


Now we come to an important inequalhty. 


6.26 pesye/ 7eg777 


SuDDOSe 6],…, 6 1S an orthonormal list of vectors in ' Hf の? と Vthen 


2 2 
oe) ドキ ー ィ ド Keg) < le に 


Proof Supposeo と V Then 


の 三 (の 6176」 オキ … 二 (の 6726 キワ ー (の ,6176」 一 ーー (の 6) 
ューーーーーーーーー- 一 ーーーーーーー ーーーーーーーーーーーーー 一 ーーーーーーーーー 
7 r77/ 
Let zando be defined as in the equation above. IT た 6 {1,.…,77), then 
(の ⑦,e) 三 (の ez) 一 〈《@, 反 7(6。。 反 ) ニ 0. This implies that (の ,7) = 0. The 
Pythagorean theorem now implies that 


2 2 の 4 
lg に "=l に "に +lW 
> II 
2 2 
ニー 【《2T20】| +… 二 | の, )| り 


where the 1ast line comes from 6.24. 
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The next definition introduces one of the most useful concepts in the study of 
inner Droduct sDaceS. 


6.27 definitlion: o7777o7O777297 の 2y7y 


An o7 娘 277o7777 の 7 の yy Of V is an orthonormal list of vectors in that is also a 
basis of 


For example, the standard basis is an orthonormal basis of F* 


6.28 o7 娘 272O7777/ /7575 の 7 77e 77g777 /e7g777 7e の 7777O77 の 777777 2yey 


Suppose V is fimite-dimensional. Then every orthonormal list of Vectors in 
of length dim V is an orthonormal basis of 


Proof By 6.23, every orthonormal list of vectors in is Hinearly independent. 
Thus every such Hist of the right length is a basis 一 -see 2.38. 


6.29 example: 7 o777o7zo777 の gs7y の 7 F* 


As mentioned above, the standard basis is an orthonormal basis of F* We now 
show that 


is also an orthonormal basis of F* 


We have 
ちち る | リ あ + あ = ユ 


Similarly, the other three vectors in the Hist above also have norm 1. 
Note that 


(あか も あ あー) これ かすれ か (DD =0 
Similarly, the inner product of any two distinct vectors in the Hist above also 
eduals 0. 

Thus the Hist above is orthonormal. Because we have an orthonormal Hst of 
length four in the four-dimensional vector space E+ this list is an orthonormal 
basis of F* (by 6.28). 


In general, given a basis e」,.…,e6, Of and a Vector の と ゆ we know that there 
is some choice of scalars 2」, .…, の, F such that 


の 三 711 キキ の 7・ 


Computing the numbers g] , …,, that satisfy the equation above can be a long 
computation for an arbitrary basis of V The next result shows, however, that this 
is easy for an orthonormal basis 一 just take 2, (の , ex). 
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Notice how the next result makes 77e pyordo Depy or lol c7eg 


each inner Product Space of dimension pyseyg/* 7e7777 が か. 7 25 4 の 775e 7 
7 behave jike F*^ with therole ofthe 7Zog 訪 万 eco7ey7 の / 7 の 747767 se776y. 


coordinates of a vector in FE” played by 
(の , 6 ), …, (の , ら 。)・ 


6.30 77777g 9 VeC7O7 y 777767 CO777 の 777 の 77O77 O/ 72 0777O72O77727 の 7975 


SuppOose @」,…,6, 1S an orthonormal basis of and ヵ , の Then 
(&) g= (の ,e1)6」 キ … 寺 (の 6)6, 


(⑪) lg = og キー+ ト og) 


(c) (の) 三 (617( の , 61) ] … 寺 (7. 6 7 の , 6 ) 


Proof Because e」, …,e, 1S a basis of V there exist scalars 7], …,, Such that 
の 三 71 ど 1 = ee の 6 カ ・ 


Because e, .…, 6, 1S Orthonormal, taking the inner product of both sides of this 
eduation with e, gives (の , er) 三 x. Thus (a) holds. 

Now (b) follows immediately from (a) and 6.24. 

Taking the inner product of zz with each side of (a) and then using the conjugate 
symmetry of the inner product giVes (Cc). 


6.31 example: 記 z の 7zg coe 褒 c7e775 7 の 7 9 77776 の 7 CO774 の 777977 の 7 


Suppose we want to write the vector (1,2,4,7) F3 as a linear combination 
of the orthonormal basis 


1 1 1 1Y /1 1 1 1YN 71 1 1 1 1 1 1 1 

( あ 23 2 上 (人 あ 0 ( あ 衣 の ョ (に 生 25 2? 2) 
of E! from Example 6.29. Instead of solving a system of four linear equations 
in four unknowns, as typically would be required if we were working with a 


nonorthonormal basis, we simply evaluate four inner products and use 6.30(8), 
getting that (1, 2,4,7) equals 


1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 
7( あ あぁ ぁ ぅ ) 4 人 (ああ ーー ラミ) ( あ ーー ショ) 2(- あ あー あっ) 


Now that we understand the usefulness of orthonormal bases, how do we go 
about finding them? For example, does の ア ,(R) with inner product as in 6.3(c) 
have an orthonormal basis? The next result will lead to answers to these questions. 

The algorithm used in the next proof greez Cy (7830-7976) gg 万 7 の 7 の 
is called the 747-5c777777 7 の Ce@g7/76. Sc/777 の 7 (78Z6- 7959) pop7277zeg の 7y 
It gives a method for turning a Hinearly 7go777777 77d7 CO7797774C75 777O72O777207 
independent list into an orthonormalHst 7 
with the same span as the original jist. 
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6.32 CO7z77-5c7777777 の 7 の Ce の 777 


SuDDOSe の 」, …, の, 1S 8 hnearly independent list of vectors in V Let 廊 = の 」. 
For = 2,.…, 7 define inductively by 


(の 。 方 ) (の 。 胡 - 1〉 
IM 上 0 I_iP 7 


Then 6」, …, 6 1S an orthonormal list of 


友 = み 一 


For each た = 1,.…,77, let e, = 
Vectors in V such that 


/ 
/ 


SDan( の 1, …, の 。) 三 SDan(e] , …, @) 


for each = 1, .……,77 


Proof We will show by induction on た that the desired conclusion holds. To 
get started withk = 1, note that because e」 = 方 川 串 , we have le = 1: also, 
SDan( て 」) 三 SDan(e) because e」 is a nonzero multiple of の 」. 

Suppose 1 < た < 7zandthe list e」,.…, er_」 generated by 6.32 is an orthonormal 
Hist such that 


6.33 SDan( の ],…, Or_ 1 ) 三 SDan(6],…, 6 ー1)・ 


Because の 」, .…, の, 1S Hinearly independent, we have ?, span( の 」, ……, の み _- 1). Thus 
の 生 span(e」,…, 反 -1) 三 SDan( 方 ,…, 太 - ュ ), Which implies that ん 0. Hence 
we are not dividing by 0 inthe defmition of e, given in 6.32. Dividing a Vector by 
its norm produces a new Vector with norm 1: thus llel| = 1. 

Let 7 (1,…, た 一 1). Then 


(@。 の 7 三 7 の 
9/ 
_ 1 _ (の 。 カ )。 (の 衣 -1) 
- IM 電 及 ( ゅ 7 上 P 太 E た ょ 
ー Te が ーe が) 
の 


= 0. 


Thus e」,.…, er 1S an orthonormal list. 
From the definition of e, given in 6.32, we see that ?。 spDan(e」,…,). 
Combining this information with 6.33 shows that 


SDan( で 」, …, 6) CC SDan(e], ……, 6)・ 


Both Hists above are linearly independent (the の s by hypothesis, and the es by 
orthonormality and 6.25). Thus both subspaces above have dimension ん and 
hence they are equal, completing the induction step and thus completing the 
proof. 
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6.34 example: 72 O777777O777797 の gy7y の 7 グ の >(R ) 


Suppose we make の 。(R) into an inner product space using the inner product 
given by 


ゅ の =| 


for al か 7 の (R). We know that 1, *, ァ ^ is a basis of グ 。(R), but it is not an 


orthonormal basis. We will find an orthonormal basis of の 。(R ) by applying the 


Gram-Schmidt procedure with o」 ニ 1, 6。 ニ *, and の 。 ニ Y^ 


To get started, take 片 = o」 = 1. Thus | 訪 = 人 1 = 2. Hence the formula 
in 6.32 tells us that 


(の , 方 ) ーー (?, 1 ー ァ 
II Mg 
where the last eduality holds because (r, 1) = 人 # み = 0. 


The formula above for 訪 implies that | = 上 だ 大 = 3. Now the formula 
in 6.32 tells us that 


ー (⑥3, 方) (の 3, 〉 
な = ター 和 E カー 


The formula above for 訪 impHes that 
1 2 1 
1 2 1 8 
IP=| (P- み =| (“- 記 すみ = お ・ 
Now dividing each of 方 , , 訪 by its norm gives us the orthonormal list 


UEIGE 


The orthonormal Hist above has length three, which is the dimension of の 。(R). 
Hence this orthonormal list is an orthonormal basis of の 。(R) [by 6.28]. 


ああ = ニ の 


方 ニ * 


ムー デー の 9ー80 ら 2 ニダー 


5 


Now we can answer the question about the existence of orthonormal bases. 


6.35 ex/s7e7zce oO/ O7777O74O7777/ 575 


Every finite-dimensional inner product space has an orthonormal basis. 


Proof Suppose V is finite-dimensional. Choose a basis of Apply the Gram- 
Schmidt procedure (6.32) to it, producing an orthonormal list of length dim 
By 6.28, this orthonormal list is an orthonormal basis of 


Sometimes we need to know not only that an orthonormal basis exists, but also 
that every orthonormal list can be extended to an orthonormal basis. In the next 
corollary, the Gram-Schmidt procedure shows that such an extension is alWays 
POSsible. 
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Proof Suppose e,…, 6, 1S an orthonormal list of Vectors in / Then e」 ,…, 6 
is linearly independent (by 6.25). Hence this Hist can be extended to a basis 
っ の の っ っ の Of (see 2.32). Now apply the Gram-Schmidt procedure 
(6.32) 0 6, の) …) の DTOducing an orthonormal Hist 


6 ec お 


here the formula given by the Gram-Schmidt procedure leaves the frst 77 Vectors 
unchanged because they are already orthonormal. The list above is an orthonormal 
basis of by 6.28. 


Recall that a matrix is called upper triangular if it looks like this: 

* * 

0 * 

where the 0 in the matrix above indicates that all entries below the diagonal 
edual 0, and asterisks are used to denote entries on and above the diagonal. 

In the last chapter, we gave a necessary and suficient condition for an operator 
to have an upper-triangular matrix with respect to some basis (see 5.44). Now that 
we are dealing with inner product spaces, We Would like to know whether there 
exists an o777o7o7777 basis with respect to which we have an upper-triangular 
matrix. The next result shows that the condition for an operator to have an upDer- 


triangular matrix with respect to some orthonormal basis is the same as the 
condition to have an upper-triangular matrix with respect to an arbitrary basis. 


6.37 7 の Pe7-777472874747 777777 克 7777 765 の 6C7 7 の ゞ O7776 07777O72O777297 の 975 


Suppose V is finite-dimensional and7 々 (ゆり ). Then 7 has an upper- 


triangular matrix with respect to some orthonormal basis of 下 and only 下 the 
minimal polynomial of ア 7 equals ( ヶ ー A」)…( ヶ ー ん ) for some 和 A, … ん F. 


Proof Suppose 了 has an upper-triangular matrix with respect to some basis 
の … の 。 Of Thus span( の 」,.……, の ) 1S inVariant under 7 for each = 1,.…, カ 
(see 5.39). 

Apply the Gram-Schmidt procedure to の 」,…, の ,, DrOducing an orthonormal 
basis e」,…, 6 Of / Because 


SDan(e, ……, ) 三 SDan(], ……, の ) 


for each た (see 6.32), we conclude that span(e, .…,e) 1S invariant under 了 for 
each た = 1, …,7. Thus, by 5.39, ア has an upper-triangular matrix with respect to 
the orthonormal basis e」,……,6. Now use 5.44 to complete the proof. 
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For complex Vector spaces, the next sai Sc (7825-7947) pr の 77s が eg g 


result is an important application of the proor の 7 万 e ey7 7esr7 7 790 の . 
result above. See Bxercise 20 for a Ver- 


sion of Schur's theorem that applies simultaneously to more than one operator. 


6.38 5c/7y 77eo7e777 


Every operator on a finite-dimensional complex inner product space has an 
upper-triangular matrix with respect to some orthonormal basis. 


Proof The desired result follows from the second version of the fundamental 
theorem of algebra (4.13) and 6.37. 


7777eg7 774727C77O77975 O77 77777e7 7 の gc7 SDgC@y 


Because Hnear maps into the scalar feldF play a special role, we defined a special 
name for them and their Vector space in Secton 3F. Those defimitions are repeated 
below in case you skipped Section 3F. 


6.39 definition: /77eg7 太 72c77 の 7 の 7 の 4 の 7 spgce, 7 


es A 7/77eg7 72c7 が 7 の 7 on V is a Hinear map from to F. 


e The gg/ ygce of V denoted by V, is the vector space of all jnear 
functionals on In other words, "= /( ル 〒). 


6.40 example: /7eg7 7zc77og/ o7 F" 


The functon の ゅ : FEF っ Edefined by 
の (Z1, 2 っ , 2 ) 三 2z」 一 52。 二 23 
is a linear functional on FE* We could write this linear functional in the form 
の (②) 三 (2,7⑰) 


for every z  F? where zo = (2, 一 5,1). 
6.41 example: /77zeg7 用 77c7o7g7 o7 5(R) 
The function の : グ 。(R) っ R defined by 


1 
の の) ニ 上 (の (cos(Z り ) 


is a hnear functonal on グ 。(R). 
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fo モリ ゆ then the map that sendSs 4 7 ey7 7es7 5 ed 太 onor 
to 〈⑰, の ) is a inear functional on 履 The の 万 zgyes Azeyz (7880-7956), wo 
next result states that every linear func- oeg seve7g/ 太 eo7e77s eg77y 女 7 が e 
tional on Vis of this form. For example,。 ez7ze77 ce の 7y 太 g7 oo ん ve7y 7 
we can take o 三 (2,-5,1) in Example  / 放 ee7esz/7 pe/ow: 
6.40. 

Suppose we make the Vector space ゲ 。(R) into an inner product space by 
defining (⑰,9) = 由 女 . Let の be as in Example 6.41. It is not obvious that there 
exists 7 三 7 ぉ (R) such that 


1 
上 p(⑰(cos(ZD) = (の. の 


for every p グ 。(R) [we cannot take 7() cos(7r の because that choice of is 
not an element of 7L(R)]. The next result tells us the somewhat surprising result 
that there indeed exists a polynomial 7 7。(R) such that the equation above 
holds for all ヵ 6 の 5(R). 


6.42  /7es< 7e/76y6777277O77 777eO76777 


Suppose is finite-dimensional and の is a hnear functional on " Then there 
is a unique vectoro Vsuch that 


の (7) 三 (4 の) 


for every 4 


Proof Hirst we show that there exists a vector の such that の (4) = (4 の) for 
every Lete」,.…,e, be an orthonormal basis of じ Then 


の (4) = @((⑰。 em)e キー キ (4 の.)6。) 
三 (7 1) の (6 ) キ … 填 (7.6) の (6,) 
= (4 の (en) オー の (6)6。) 
for every z と where the frst equahty comes from 6.30(a). Thus setting 
6.43 り 三 の (@) 本 キー+ の ()@ 


we have の (4) (4 ヵ の ) for every as desired. 
Now we prove that only one vector の has the desired behavior. Suppose 
の 」, の > ビザ are such that 


の (⑦⑰) 三 (4 の]) 三 (4 の 2) 
for every 7 と Then 
0=(《⑯4, の) 一 (5 の ) ニ (5 婦 一 の ) 


for everyz V Takingz = ニ ?」ーoe。 shows that の 」 一 ?。 = 0. Thus の 」 = の っ , 
completing the proof of the uniqueness part of the result. 
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6.44 example: Co7 の 7277O77 777749777746 7ey< 76 り 7 の ye727777O77 7776O76772 


Suppose we want to find a polynomial 7 と の 。(R) such that 


1 1 
6.45 較 p⑰(cos(z り ) = 性 p 


for every polynomial ヵ と の 。(R). To do this, we make >(R ) into an inner product 
Space by defming ヵ , 9) to be the right side of the equation above for ヵ ,7 と の (R). 
Note that the left side of the equation above does not equal the inner product 
in の 。(R) of ヵ and the function# ご cos(Zr7) because this last function is not a 
polynomial. 

Defime a Hinear functional の on の (R) by letting 


1 
の (⑦⑰) = 上 (の (cos(Z の ) 大 


for each ヵ の 5(R). Now use the orthonormal basis from Example 6.34 and 
apply formula 6.43 from the proof of the Riesz representation theorem to see that 
立 り の (R), then の ⑦⑰) = (の 9, where 


9(X) ニ ([ V3 cosrD 43 ([ Vireos(zo d V 
+ ([ V ぎ (P ー ぅ ) cos(Z り ) w] 当 ( 記 ー 昌 


A bit of calculus applied to the equation above shows that 
不 (⑳) 喧 > (1 ー 3*”). 
The same procedure shows that we want to fnd 7 グ 。(R) such that 6.45 


holds for all ヵ 6 の 。(R), then we should take 


9⑨ = 問 ((22- 2 の ) + (2472 ー270)2+ (315 30z2)x* ) 


Suppose V is fimite-dimensional and の a Hnear functional on Then 6.43 
gives a formula for the vectoro that satisfies 


の (4) 三 〈⑰, の) 
forallz と VSpecifically, we have 
りー の (6 キオ … 十 の (らら, 


The right side of the equation above seems to depend on the orthonormal basis 
6 … っ 6, 3S well as on の . However, 6.42 tells us that の is uniquely determined 
by の . Thus the right side of the equation above is the same regardless of which 
orthonormal basis e」, .…, 6, Of Vis chosen. 

For two additional different proofs of the Riesz representation theorem, see 
6.58 and also Exercise 13 in Section 6C. 
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re7c7yey 6/ 


1 Suppose e」,…, 6 1S a Hist of vectors in such that 
2 2 2 
1 オキ ーー の 6 に モビ キー…ー オ | 


for all 7],…, み ,  F. Show that e」,…, 6 1S an orthonormal Hist. 


777y ere7C7Se 7 の OV7 の ey CO72Ve75e 7 の 6.2 プ . 
2 (a) Suppose 9 R. Show that both 
(cos@.sin の ),( 一 sin の の cos の and (cos@sin の ,(sin の ーーcos の ) 


are orthonormal bases of R^ 
(b) Show that each orthonormal basis of R< is of the form given by one of 
the two possibilities in (a). 


3 Suppose e」,… 6 1S an orthonormal istin andoeV Prove that 
2 2 
lgl^ = [og キー+ ド og つの 6 span(,……,6。)・ 
4 Suppose71s apositive integer. Prove that 
1] cosY COS2r COS 7 SInY Sin2 S1n 7 
y2Z 宛 k 宛 に aban- 宛 介 元 宛 Fo 宛 


is an orthonormal list of vectors in C[ 一 Z 77], the Vector space of continuous 
real-valued functions on [一 元 , 7] with inner product 


(8) = 「 げ g. 


万 7 77e 727/2w7g 7277274745 SO747 7e. 


Sin(Yー7) sin(Y+⑰) 


(sin >)(cos) = っ 

(sin *)(siny) = cos(Yー) っ coOs(Y 十 ) 
COs( メ ー) 十 COS( そ +) 

(cos)(cosy) = っ 


5 Suppose が [一 , 7] つ R is continuous. For each nonnegative integer ん た, 
define 


7z 三 寺 「 7o cos(ky) み の and 太 = 寺 「 7 sin( ん y) の. 
Prove that 上 
さき ょ Ye+ の < た 
2 己 ー た 


77e 7e94 の 7 の の の ove 75 gc774977y の 77 9677 の 7 の 7 77 co77777274O745 477C77 の 779 
だ [一 7z, 7r] つ R. 右 oweve7 7ov77g 7 万 7 ed777 75 7 69777y 
72VO/vey 万 OZ77e7 Se776 ゞ 7eC77777946 ゞ の eyO7 の 7e yco/e の / 7775 の oo た ん. 
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6 Suppose e」,…。 6 1S an orthonormal basis of 
(a) Prove that if の 」,…, の , are Vectors in such that 
1 
le 一 vjl < 3 記 


for each ん then o」, .…, の , 1S a basis of / 
(b) Show that there exist o」, .……, の , 三 V such that 


1 
le 一 < ーー 
V 
for each ん but o」,…, の, 1S not hnearly independent. 
777y ere7C7ye 57776 ゞ 777 (6) 777 G72 の 7 の /77976/ 5772777 Pe7747 の 77 の 77 の / 77 


O777o77O7777 の 75 7 の 575. 77e77 (の ) yos 万 27 77e 777777 の e7 1/V7 の 7 万 e 
77g777 7 の e の / 77e 7 の の 77 72 () cg777207 e 777 の 7 の Ve の 74 の の 77. 


7 Suppose ア と ィ (R3?) has an upper-triangular matrix with respect to the basis 
(1,0,.0), (1, 1, 1), (1, 1,2). Find an orthonormal basis of R3 with TeSDect to 


which 7 has an upper-triangular matrix. 


S Make の (R) into an inner product space by defining ( ヵ ,9) = 詳 7 for al 


9 の 。(R). 


(a) Apply the Gram-Schmidt procedure to the basis 1,y,x^ to produce an 


orthonormal basis of の 。(R ). 


(b) The differentiation operator (the operator that takes ヵ to ア ) on の 。(R) 
has an upper-triangular matrix with respect to the basis 1,, 2 which is 
not an orthonormal basis. Find the matrix of the differentiation operator 
on の 5(R) with respect to the orthonormal basis produced in (a) and 
verify that this matrix is upper triangular, as expected from the proof of 


6.37. 


9 Suppose e, …, 6 1S the result of applying the Gram-Schmidt procedure to 
a hnearly independent list o」, …, の in Prove that ( み ,e) > 0 for each 


ん = 1, .…,77. 


10 Suppose の ,…, の 。 1S a hnearly independent hst in V BExplain why the 
orthonormal list produced by the formulas of the Gram-Schmidt procedure 
(6.32) is the only orthonormal list e」, …,e。 In V such that (o。,) > 0 and 


SDan( の 」, ……, の) 三 SDan(e」,.……, 抽 ) 1Or each = 1,.…,77. 


77e 7es777 7 7775 eXe7C7Se 7 6 の 7 77e 7oo/ の 7 /. う 6. 


11 Findapolynomial 7 の (R) such thatp( ぅ ) 三 剛 四 for every ヵ 6 の >(R). 


12 Eind apolynomial 7 と の.(R) such that 


eocose の gw= 
0 Z) XY 三 交 


for every ヵ の 5(R). 


13 


14 


15 


16 


17 


18 


19 


20 


21 
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Show that a ist の,…, の, Of vectors in is linearly dependent if and only 
the Gram-Schmidt formula in 6.32 produces た = 0for someE 代 ,…,77). 
777y ere7C7ye gey 77 77e777 の 77Ve 7 の 745S772 67777277277 の 77 76C777777776 ゞ 7 の ア 
ge7e7777777779 We770e7 g 757 の 7 vec7 の 7 777 72 7777267 7 の 7 の Ce 75 7777e27y 

gee74 の 6777. 


Suppose V is a real inner product space and の ,…, の 。 1S a Hinearly indepen- 
dent list of vectors in V Prove that there exist exactly 2 orthonormal ists 
1,… っ 6 Of vectors in V such that 


SDan( の ], ……, Cr) 三 SDan(61,…。, 反 ) 
for all た {1,.…, 嫌 ). 


Suppose (1 and (。・)2 are inner products on V such that (2. の )」 ニ 0 下 
and only if (》 ヵ の )。 = 0. Prove that there is a positive number c such that 
(7。 の )」 三 C〈7。 の )。 for every の 

777y ere7C/ye oyy 7 が no 727267 7 の gc が 5 ve 万 e y7776 Pd77y の / 

の 7777ogo7G/ vec7O75$, 7 如 e77 egC7 の 7 770e 777767 の 7 の の 7S 75 の Cd/7 77277777 の 7e 

の 7 万 e o77e7 777767 の 7 の gd77C7. 


Suppose V is fimite-dimensional. Suppose (1, (っ) are inner products on 
Y with corresponding norms |・|」 and |. Prove that there exists a positive 
number c such that lg < cllgll。 for everyo と どど 


SupposeF =CandVis fnite-dimensional. Prove that エ 了 is an operator 
on Vsuch that 1 is the only eisenvalue of ア and 7oll < lgll for allo と 
then 了 is the identity operator. 


SuppOose 2 …, 7 1S 8 Hinearly independent list in じ Show that there exists 
の と ツリ such that ( 寺 , の ) ニ 1 for allk 6 {1,.…,77). 


SuppOse の 」, …, の , 1S a basis of V Prove that there exists a basis 4, .…, 4 Of 
V such that 
0 ザ 7/ チ ん 
の ,, 77) 三 
0 人 0 下 / ニ た 
Suppose F = で , is finmite-dimensional, and て 々 () is such that 
S ア = ェ 7 イ 5 


for all 5,7 どど . Prove that there is an orthonormal basis of with respect 
to which every element of 〆@ has an upper-triangular matrix. 
777s ee7C7se 5767g 加 e75 研 e7c7Se の (の ) 7 Sec77O7 う 女 (7 77e co747e7 の 7 777767 
7 の Og7zc7 ygC6y) の y 5ye7777g 太 7 7e の gy75 77 万 7 ere7C7Se Cg72 の e C77Oye77 7 の 
pe o7777O77 の 7777/. 


SupposeF = で , Vis finite-dimensional, 7 と 々 ( ゆ ), and all eisenvalues 
of 了 have absolute Value less than 1. Let e > 0. Prove that there exists a 
positive inteser 77 such that 7 < ellgll for everyo の と 
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22 Suppose C[ 1, 1] is the vector space of continuous real-Valued functions 
on the interval [一 1, 1] with inner product given by 


(8) = [ 7 


for all が egC[-1, 1]. Let の be the linear functional on C[ 一 1, 1] defned 
by の (の = 0). Show that there does not exist C[ 一 1, 1] such that 


の () ニ (8) 
for every / と C[ 一 1, 1]. 


777y ee7C7Se 577Oy 777 777e 7eyZ 7e/76y@777777O77 777eO7e777 (6.2 ) 2es 77o7 
7o/ o7 77777776- の 77767257O727/ ec7O7 ゞ DC@ ゞ 7777O77 9777O7 の 7 の 77eyey 
7 g77 の . 


23 Forallzo と define 7 の) = | 一. 


(a) Show that is ametric on 

(b) Show that if Vis finite-dimensional, then 7 is a complete metric on 
(meaning that every Cauchy seduence ConveTees). 

(c) Show that every fmite-dimensional subspace of V is a closed subset 
of V (with respect to the metric 7 ). 


777o ere7C7Se 7@974776y /27777772777 W777 7776777C SDC@S 


O777ogo7g7 の g7 77e 67 の 7e7776 CO777 


Law professor Richard Friedman presenting a case before the U.S. Supreme 
Court in 2010: 


47z 777eg の ig77: 上 think that issue is entirely orthogonal to the issue here 
because the Commonwealth is acknowledging- 

C77e//zy7 が ce oe77y: T'm sorry. Entirely what? 

ル 477 77eg の 7: Orthogonal. Right angle. Unrelated. Irrelevant. 

C77e/7zy7 が ce oe77y: Oh. 

7zy7ce Scg77g: What was that adjective? 1 liked that. 

77z 777e の 7 Orthogonal. 

C77e/ zzy7 が ce Ao の e77y: Orthogonal. 

477 77eg の 7z7: Right, right. 

7zs7zce Scg7g: Orthogonal, ooh. (Laughter.) 


7zy77ce e7e の y: T knew this case presented us a problem. (Laughter.) 
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6C O777ogo7g7 CO77 の 7e77767775 777 ル 777777777<777O77 /7 の //6777? 


0777ogo727 CO777/67776777 ゞ 


6.46 definition: o777ogo7z7 co7 の 7e7e777 リエ 


TfUisasubset of then the o77 が ogo7g7 co7 が p/e72e77 Of , denoted by ロ エ is 
the set of all vectors in that are orthogonal to every Vector in  : 


= (の と : (の ) =0foreveryz 


The orthogonal complement ~ depends on as well as on /. However, the 
inner product space " should always be clear from the context and thus it can be 
omitted from the notation. 


6.47 example: の 7 娘 Og の 72d/ CO777 の /677767775 


e If ソニ RYand 7isthe subset of consisting of the single point (2,3,5), then 
+ is the plane {(y,7,Z) と R* : 2x+3y+5z =0). 


es If ソニ RYand isthe plane {(X, か 2)  R? : 2x+3y+ 5z = 0), then Tis 
the line {(2.3.5 の り : R). 


e More generally,i is a plane in R* containing the origin, then ~ is the line 
containing the origin that is perpendicular to /. 


e IfUisalinein R? containing the origin, then ~ is the plane containing the 
origin that is perpendicular to . 


e If ソニーE"and ニ ((@⑫. ち 0.0.0) と F” : pF), then 
+ = 人 (00 2) Ei ャ 2 と FE). 
Te 6 旋 ,…。 太 1S an orthonormal basis of V then 


(span(e,…。e))~ 三 span( 方 ,…。 訪 ) 


We begin with some straightforward consequences of the definition. 


6.48 7o/e777ey の / O7777OgO77/ CO777 の /67776777 


(a) isasubset of 攻 then is a subspace of 
(D) 呈 0 


(c) リ += (0). 
(④⑰ If is a subset of 履 then ロロ て C (0). 
(e) TE G and 互 are subsets ofandG て 万,then 有 よ てこ G+T. 
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Proof 
(&) Suppose is asubset of Then (0) = 0 for every z 万:thus0 と ~ 
Suppose o, の と If と,then 
(7 の 十 の ) 三 (2. の) 填 (72, の ) 0+0=0. 
Thus o+ の と し] which shows that is closed under addition. 
Similarly, suppose 人 と Fando と ロ +. TTze U,then 
(⑰。 Ao) = Ao) 三信 ・0=0. 


Thus Ao と which shows that リ ~ is closed under scalar multiplication. 
Thus  ~ is asubspace of 芝 


(b 


ヽ ュ ン 


Suppose thato と Then (0,o) = 0, which implies that o {0} Thus 
但 選 必 


(c) Suppose that o 三 V+. Then (o,o) = 0, which implies that o = 0. Thus 
て 三 加 )、 


(d 


ュ ン 


Suppose is a subset ofand 7 ロロ Then (77) = 0, which implies 
that ヵ =0.ThusUnUT て (0). 


(e) Suppose G and 万 are subsets of ソ andGC 万 . Suppose o e 万 ~. Then 
( ヵ 。 の ) 三 0 for every z 6 万, which implies that (4, の ) = 0 for everyz  G. 
Henceo と GT. Thus 刀 て GT 


Recall thatf and W are subspaces of V then Vis the direct sum of and 
WW (written ソニ リ @ ゆ W) ぜ each element of can be written in exactly one way 
asavectorin plus a vector in W (see 1.41). Furthermore, this happens tf and 
only ソ = ニ ロ + Wand 有 UnW= テ (0) (see 1.46). 

The next result shows that every fnite-dimensional subspace of leads to a 
natural direct sum decomposition of See Exercise 16 for an example showing 
that the result below can fail without the hypothesis that the subspace U is fimite- 
dimensional. 


6.49 g77ec7 s7772 7 の 577/ の 5 の Ce 7 775 O7777OgO7777 CO777 の 767776777 


Suppose is a finite-dimensional subspace of / Then 


= リリ @ 器 上 


Proof Hirst we will show that 
= ニ ロ + ロ エ 


To do this, suppose thato と V Let e」,…, eg be an orthonormal basis of U. We 
want to write o as the sum of a vector in and a vector orthogonal to /. 
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We have 


6.50 の 三 (の , 6176」 キオ … 二 (の 6726 キサ ワー (の ,6176」 一 …ー (の 6) 

Il 語詞 上 に に 
Let z and の be defined as in the equation above (as was done in the proof of 6.26). 
Because each eg と U,weseethatz ヒ リ . Because e」, …, 6,, 1S an orthonormal 
list, for each た = 1,.…,77 We have 


(の ⑰, g&) 三 ( の 6k) 一 《 の 6) 

= 0. 
Thus の is orthogonal to every Vector in SDan(e] ,…,6。), Which shows that / ロニ 
Hence we have writteno ニ x+ の ,wherez 三 andw ロ completing the 
proof that ソ ニ リ + ロ リエ 


From 6.48(①, we know that ロロ = (0). Now equation "= ニ リ ロ + ロ + 
implies that ソ ニー リ @~ (see 1.46). 


Now we can see how to compute dim ロ + from dim U. 


.51 77e7757O77 の 7 7777OgO77/ CO777 の /67776777 


Suppose V is finite-dimensional and / is a subspace of じ Then 


dimU+ = dm リー dim /. 


Proof The formula for dim  ~ follows immediately from 6.49 and 3.94. 


The next result is an important conseduence Of 6.49. 


6.52  o7 娘 ogo7/ co7777/e7776777 の 7 777e O7777OgO749/ CoO77 の /67776777 


Suppose is a finite-dimensional subspace of / Then 


= (0) こ 


Proof Hirst we will show that 
6.53 本 だ (US 


To do this, suppose 7  . Then (4 の) = 0 for every の と リ ~ (by the definition 
of U+). Because zis orthogonal to every vector in we have 7 と (UT) う 
completing the proof of 6.53. 

To prove the inclusion in the other direction, suppose o モ ( ロ )~. By 6.49, 
wecan writeo ニ 7+ < の,wherey と and と Wehaveo-ー ル タニ の ロロ エ 
Becauseo(U+)~ and 7 と (U サ )~ (from 6.53). we haveo-- と (りー Thus 
ゥ 一 ロロ ( ロ T)~, which implies thato-- = 0 [by 6.48(d)], which implies 
that o = ヵ 。 which implies thato U. Thus (UT)~ CU, which along with 6.53 
completes the proof. 
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Suppose is a subspace of V and 


re7c7ye 76(@) sowsy 7727 77e 7ey74/7 
we want to show that ガ = ニ ツ V Im some 


pe/ow 5 707 7746 W7777 の 7 76 が 077ey7y 


situations, the easiest way tO do thisistO 訪 Z7 Us 大 放 - の es7o7g/ 

show that the only Vector orthogonal to 

/ is 0, and then use the result below. For example, the result below is useful for 
Exercise 4. 


6.54 ロロ エニ (0) < 呈 リニア (7 4 亡 777e- の 7e7257O747 y/ の Ce の 7 ) 


Suppose 7 is a finite-dimensional subspace of / Then 


人 三 0 で > 個 三 ゆ 


Proof First suppose ロ ~ = {0}. Then by 6.52, U = (U)~ = (0 エニ as 
desired. 

Conversely, 導 ニル then ロニ リ +=(0} by 6.48(c). 

We now define an operator 片 , for each finite-dimensional subspace Uof 


6.55 definition: o7777ogo77 7 の /6c77 の 77, 散 」 


Suppose is a finmite-dimensional subspace of The o777ogo724/ 7 の /ec77O77 


of onto Uis the operator 上 , 々 (V) defined as follows: For eacho と ゆ 
writeo 三 7+ の ,Wwherez 三 Uande と ロリ ~. Then let 朋 の = 


The direct sum decomposition ソ ニー リロ リ @ り ~ given by 6.49 shows that each 
o と ツリ can be uniquely written in the formo ニ 7+ の withz 三 Uandw と ロリ] 
Thus 表 p is well defined. See the figure that accompanies the proof of 6.61 for 
the picture describing 上 , の that you should keep in mind. 


6.56 example: o777Og の 747 7 の /@C77O77 の 77 の の 726- の 777767257O729/ y7/ の DC@ 


Suppose withz チ 0andUis the one-dimensional subspace of 
defined by = span(7 の ). 
Ifo と then 


(の , 4) ( (の , 7 ) 
呈 7 十 * 7 1。 
II II 
where the first term on the right is in span(?) (and thus is in ) and the second 
term on the right is orthogonal to (and thus is in ~). Thus 用 ,o equals the first 
term on the right. In other words, we have the formula 


(の , 7) 


り の ニーーー ル 
Ia 


for everyo と V 
Takingo= ヵ the formula above becomes 上 7 三 7 aS expected. Furthermore, 
taking ? {4 て the formula above becomes 乃 ,o = 0, also as expected. 
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6.57 7o/e777es の 7 o777Og の 7247 7 の 7ec77O77 万, 


Suppose is a finite-dimensional subspace of / Then 
(@) 片 , E る (の): 
(b) j = zfor every z  : 


(c) 孔 , =0 for every の と けり ^: 
(d ranee 玉 , = ロロ い : 


(GuuUM 一 0 
⑪ 
@ = 本 
Q⑪ 
⑪⑬ 


oー 有 の と どり ~forevery oe リツ W: 


Irgll < lgl for everyoe ゆ の: 


ig,…, 6 1S an orthonormal basis of Uand の と then 


月 7 の (の ,e1)6」 寺 … 填 ( の 6。26 か ・ 


Proof 


(⑧ 


(⑤⑪) 


(@ 


(d 


* ン 


(@ 


To show that 巧 , is a Hmnear map on suppose の 」, の 。 ビ Write 
の 」 三 4 十 の 」 and ? の っ 5 二 の っ 

with no 人 and の 」, の > Thus 万, = and 玉 , の > 7 め . Now 
の 」 填 の > 三 (4 十 7 め 5) 十 (の 1 十 の 2), 

where 5 and の 」+ の 。 所 -. Thus 


Similarly。suppose 人 Fand の と V Write の = ニル + の where リプ 
and の 三 Then Ao = Az+AowithAz andAp ET. Thus 
上 (Ao) = Az = ル 玉 7 の . 

Hence 玉 , is a Hnear map from to 


Suppose 7 . Wecan writez ニ 7+0,wherez と and0 と Thus 
7/ 拓 一 和 / 有 

Suppose eo と We can write の o 0+o,where0 と ando と Thus 
7 の =0. 

The definition of , imphes that range 表 , て り . Furthermore, (b) implies 
that Crange 片 ,. Thus range 片 , ロリ. 


The inclusion て nul, follows from (c). To prove the inclusion in the 
other direction, note that if null 用 , then the decomposition given by 6.49 
mustbeo=0+o,where0 モ ando と /~. Thus null 用, て て 
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() Ifo と ando= ニ x+ の wwith と ando と し then 


の 一 用 の ニ の ワー み 7 ニ の 三 ] 
(g) fo と ando=x+wwithzEandoE ロ then 
(P の 9 = P,(Pro) ニ 玉 ニル ニーロ の. 
(h) Ifo と ando= ル + の withg と and の と し then 
IPgl* = 7 < HMI 人 + lg に = lg 
where the last equality comes from the Pythagorean theorem. 


G① The formula for 表 ,p follows from equation 6.30 in the proof of 6.49. 


In the previous section we proved the Riesz representation theorem (6.42), 
whose key part states that every linear functional on a finite-dimensional inner 
product space is given by taking the inner product with some fixed Vector. Seeing 
a different proof often provides new insight. Thus we now give a new proof of 
the key part of the Riesz representation theorem using orthogonal complements 
instead of orthonormal bases as in our previous proof. 

The restatement below of the Riesz representation theorem provides an iden- 
Gification of with V. We will prove only the “onto” part of the result below 
because the more routine “one-to-one” part of the result can be proved as in 6.42. 

Intuition behind this new proof: の と ずり, の と and の (の め = (の ) for al 
7 ツル theno モ (null の) However, (null の )~ is a one-dimensional subspace 
of V (except for the trivial case in which ゅ = 0), as follows from 6.31 and 3.21. 
Thus we can obtain o be choosing any nonzero element of (null の )~ and then 
multiplying by an appropriate scalar, as is done in the proof below. 


6.58  /7es< 7e/76y6777277O7 777eO7e777, 76V7S77e の 


Suppose V is finite-dimensional. For eacho と defne eg。 と by 


の 。(74) 三 (4 の ) 


for eachz と Theno の 。 is a one-to-one function from onto ぴ " 


Proof 10 show that の ウロ の 。1S SurjectiVe。 Cop・ 77e con の つ の 。 な の 
suppose の ビリ. の =0,then の = の 0. 太 eg7 7 の P77g 7o77 7 の リザ が ドーR. 
Thus assume の チ 0. Hencenull の まゆ 記 yevez 放 s Ac7 が 7 が 5 7 の 7 777e77 が 
which implies that (null の )~ チ (0) (by E=Cpecgse の 。 = 4 の 。 が と で. 
6.49 with =null の ). 

Let oo 征 (null の )~ be such that の 0.Let 


_ の (の ⑦) 


ーーー の : 
lgl* 


ThenoE (null の )~ Also,? チ 0 (because の null の ). 


6.59 
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Taking the norm of both sides of 6.59 gives 
6.60 Il = 一 一 一 . 


Applying g to both sides of 6.59 and then using 6.60, we have 


_ |Ig( の ド ビ 


こ 2 
の (の ) le 上 P lg に 


Now suppose z Using the equation above, we have 


主 じ 呈 の ) (452 衣 
の (の ) ll 


The frst term in parentheses above is in null の and hence is orthogonal to o. Thus 
taking the inner product of both sides of the equation above with ? shows that 


_ の (の 


ll 


(7 の ) (の , の) 三 の (7). 


Thus g = の 。, Showing that の の 。 1 surjective, as desired. 


See Exercise 13 for yet another proof of the Riesz representation theorem. 


/7 廊 77777c27O7 7 の //e777 ゞ 


The following problem often arises: 77e 7e74272 の 7e y77 の 77c7 が の の 77e yo/- 
Given a subspace of and apoint 77 の 7 7 の 7775 7777277727< の 77O72 7 の //e77 7 


o と ど V ゆ fmdapointz と Usuchthat 7 97 7 の の 774777 GDP/ZC77O7y の / 
lg 一 串 1S as small as possible. The next 。 訪 er progdc7 pgCes Oz7 が 57e o/ 7e 
result shows that = 表 の 1S the unidue 7 廊 g 太 e72g7 が Cy. 


solution of this minimization problem. 


6.61 777777777<7726 の 75772C6 7 の の S74 の 9 の の C6 
Suppose is a finite-dimensional subspace of り の と andzー/. Then 


lg 一 抽 ,g| S lg 一 史 . 


Furthermore, the inequality above is an equalty 導 and only if 三 乃 7 の . 


Proof Wehave 
6.62 lg 一 月 ll < lp 一 玉 jal+ Ip 一 紙 だ 
= |@ ら 一 表 7 の ) + (月 廊 一 79 | 較 


2 
= | 一 還 2 
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where the frst ine above holds because 0 < | 旧 訪 一 列 ? 
the second Hine above comes from the Pythagorean the- 
orem [which applies becauseo 一 用 の とり ~ by 6.57⑪, 
and 万 の ーr 全 |, and the third line above holds by 
simple alsebra. Taking square roots gives the desired 
inequahty. 

The inequality proved above is an equality 辻 and 
only if 6.62 is an equalhty, which happens if and only ザ 
Irg 一 ゥ | = 0, which happens 半 and only f み = 太 7 の . 0 


上 7 の 5 廊 e c/oyes7 
oO777 77 7O の . 


The last result is often combined with the formula 
6.57G) to compute explicit solutions to minimization 
problems, as in the following example. 


6.63 example: 7zg 7777e7 の /ge の 7 7 の の の 7 の 777776 777e 57746 77C7 の 7 


Suppose we want to find a polynomial z with real coefcients and of degree 
at most 5 that approximates the sine function as well as possible on the interval 
[一 宛 , 7], in the sense that 


上 lsin* 一 6 う 7 ァ 


is as small as possible. 
Let C[ 丈 , 7z] denote the real inner product space of continuous real-valued 
functions on [一 巡 , 7] with inner product 


6.64 (7g) = 層 gr. 


Let o  C[ 一 7z, ] be the function defined by o(x) = siny. Let / denote the 
subspace of C[ 一, 7] consisting of the polynomials with real coeficients and of 
degree at most 5. Our problem can now be reformulated as follows: 


Findz such that lp 一 | 1S as small as possible. 


To compute the solution to our aD- 
proximation problem, frst apply the 
Gram-Schmidt procedure (using the in- 
ner product given by 6.64) to the basis 1,*, xxx 5 of , producing an ortho- 
normal basis e」, >, es, 64, 6s, 6。 Of . Then, again using the inner product given 
by 6.64, compute 表 7 の using 6.57G⑪ (with 娘 =6). Doing this computation shows 
that 万, の is the function zz defined by 


人 co7 の 4767 如 d7 Cd77 777667776 75 7456777/ 
je7e. 


6.65 7() = 0.987862r - 0.155271x? + 0.00564312y?, 


where the Zr's that appear in the exact answer have been replaced with a good 
decimal approximation. By 6.61, the polynomial z above is the best approximation 
to the sine function on [一 Z, 7] using polynomials of degree at most 5 (here “best 
approximation” means in the sense of minimizing UM | sinー (*) に の ). 
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To see how good this approximation is, the next figure shows the graphs of 
both the sine function and our approximation z given by 6.63 over the interval 
[一 77。 77 ] ・ 


ー1 


C74/7 が 5 の 7 [一 7。 7] の 77e y7726 72C77O7 (76 の ) 74 775 の es7 
が 娘 の eg7ee oO77777 の 7 の 777777O77 7 (の 77e) 記 o777 0.0 う . 


Our approximation 6.63 is so accurate thatthe two graphs are almost identical- 一 
our eyes may see only one graph! Here the red graph is placed almost exactly 
over the blue graph. If you are viewing this on an electronic device, enlaree the 
picture above by 40096 near zor 7to see a small gap between the two graphs. 

Another well-known approximation to the sine function by a polynomial of 
degree 5 is given by the Taylor polynomial ヵ defined by 

3 
6.66 の (*X) ニ ァ ー 一 + ナ 一 . 


To see how good this approximation is, the next picture shows the graphs of both 
the sine function and the Taylor polynomial り over the interval [一 7, 7]. 


1 


ー1 


7g/7 が 5 の 7 [一 7。 77] の 娘 e y772e 罰 727c77O72 (7 の) 
g77 の 77e 7 な y/o7 po の 72o77777 (の //e) 方 o777 0.00. 


The Taylor polynomial is an excellent approximation to sin for near0. But 
the picture above shows that for lr| > 2, the Taylor polynomial is not so accurate, 
especially compared to 6.65. For example, taking * = 3, our approximation 6.63 
estimates sin 3 with an error of approximately 0.001, but the Taylor series 6.66 
estimates sin 3 with an error of approximately 0.4. Thus at x = 3, the error in 
the Taylor series is hundreds of times larger than the error given by 6.635. Linear 
algebra has helped us discover an approximation to the sine function that improves 
upon what we learned in calculus! 
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アア ye77O777V67y6 


Suppose 了 と ズバ (WW) and ヵ pe W. Consider the problem of finding x と Vsuch 
that 
リル 一 


For example,f ソ = FE and W =E?% then the equation above could represent a 
system of 77 Hinear equations in 7 unknowns. 

T7 is invertible, then the unique solution to the equation above is * ニア ー) ヵ . 
However, if 7 is not inVertible, then for some ち と MW there may not exist any 
solutions of the equation above, and for some ヵ ち MW there may exist infinitely 
many solutions of the equation above. 

T 7 is not invertible, then we can still try to do as well as possible with the 
equation above. For example, if the eduation above has no solutions, then instead 
of solving the equation リャ ー5= 0, we can ry to fndx と Vsuch that 7 一 別 
is as small as possible. As another example, i the equation above has infinitely 
many solutions* ツ then among all those solutions we can try to find one such 
that ll is as small as possible. 

The pseudoinverse will provide the tool to solve the equation above as well 
as DOSsible, even when 7 is not invertible. We need the next result to define the 
DSeudoinverse. 

In the next two proofs, we will use without further comment the result that ザ 
Y is finite-dimensional and 了 と (WW), then nul17, (null 7) て and range 7 are 
all finite-dimensional. 


6.67 7es777c77O77 の 7 @ 777767- 7749 7 の の 7777 の O776-7 の - の 726 7 O777O 777 の の 


SuppPose V is fimite-dimensional and 7 と 々 (V W). Then 7 1S a one- 
to-one map of (null7)~ onto range 子 


Proof Suppose that o (null7)+ and | mpr の 三 0. Hence To = 0 and 
thus o と (null ア 7) n (null7)+ which implies that co = 0 [by 6.48(d)]. Hence 
nul イア am7) ェ ニ (0}), which implies that 7| am7)+ 1S injective, as desired. 

Clearly range 7| Gam7 ュ に range 7 To prove the inclusion in the other direction, 
SuDDOSe の range7. Hence there existso ヒ suchthat の =7o. There exist 
z 生 null7 and (null7)~ such thato= ニ x+ ァ (by 6.49). Now 


mn7yr ニナ イィ ニナ の ー イ 7 ニ の ー0 ニ の , 


which shows that p range 7|m7) ェ Hence range 了 て range 了 | の) COmplet- 
ing the proof that range 77 ュー Tange 子 . 


Now we can define the pseudoinverse 
7T (pronounced “7 dagger”) of a Hinear 
map 7. In the next definition (and from 
now on), think of | aS an invertible linear map from (nul17)+ onto range 7, 
as is justified by the result above. 


70 /7 の 97zCe 777e 60777Ve7S6 7 の 777077 
7「 廊 7 ppe T^Ndagger. 
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6.68 definilon: pyego が ve7sye, 7「 


Suppose that Vis finite-dimensional and 7 と 々 (! W). The psezo72ve75e 
7 と の (WW) of 7 is the linear map from W to defined by 


7To 三 (Yaaer の 


for each o W. 


Recall that 万 7 の ニ 0 放 の (range 7)~ and 表 aae7 の 王 の 半 の Tange 李 


Thus if の と (range7)~, then 7f の = 0, andif range 了 , then 7Top is the 
unique element of (null7)+ such that (7Too) = の. 
The pseudoinverse behaves much Hike an inverse, as we will see. 


6.69  g/ge/77c 7 の Pe67776y O/ 777e ye/7O777De7@ 


Suppose V is finite-dimensional and 了 7 と (VMW). 
(a) THF7is invertible, then 7 イニ アート 


(b) 77f「 = 玉 ase7 the orthogonal projection of WV onto range 了 . 


(c) TT ア = Pr ュー the orthogonal projection of onto (null 了 了 ) 


Proof 


(a) Suppose 7 is invertible. Then (null7) ト = リ andrange7 = W. Thus 
am7 ニチ and 表 。。。7 1 the identity Operator on WW. Hence 7 キー アー 


(b) Suppose cp range 了 ア . Thus 


77T み = ア TI の の ニ の ニア 7 の 


IF (range7) 上 then To = 0. Hence 7T7TT の =0= maer の . Thus 77f 
and 月 。。7 8gTee On range 了 and on (range 7)~. Hence these two linear maps 
are equal (by 6.49). 
(c) Suppose o と (null7) エ Because 7o と range 7, the definition of 7「 shows 
that 
7T(T) = (Tam) (7 の ) = ニ の ニア air の 


Ifo e null ア , then 7 イ T ゥ = ニ 0 = Tam7)+ の . Thus 7 ザ ア and mn7)+ 88Tee On 
(null7)~ and on null 了 7 Hence these two linear maps are equal (by 6.49). 


Suppose that ア 7 と (WW). 7 子 s 
surjective. then 7 is the identity opera- 
tor on W as follows from (b) in the result 
above. 7 is injective, then 7T7 is the identity operator on as follows from (c) 
in the result above. For additional algebraic properties of the pseudoinverse, see 
Exercises 19-23. 


77e /ye7dO772Ve7ye 75 G/yO cg//e 77e 
72o7e-/e77 の Se 777V676. 
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Suppose 7 と (WW), ち 6 Wand we want to indx と Vthat solves the 
eduation 
了 ャ ニーム の 


7 is invertible, then * = 7 アー!5 is the unique solution. is not invertible, then 
7ー1 is not defined. However, the pseudoinverse 7「 is defined. Taking x = 71 ヵ 
makes 7 as close to り as possible, as shown by (a) of the next result. Thus the 
pseudoinverse provides what is called a es 記 to the equation above. 

Among all vectors* リ that make 7 as close as possible to ち the vector 
7T ヵ has the smallest norm, as shown by combining (b) in the next result with the 
condition for eduality in (a). 


6.70 se の 2777Ve7ye の 7 の U7es の es7 の の 7OX7772776 SO/7777O77 O7 es7 ゞ 77777O72 


Suppose V is finite-dimensional, 7 々 (V W),and56 W. 


(a) Ifx と EVMthen 
ITT め - 史 <I7z 一 名 


with equality and only fx で 7f5+null 李 
(b) Ifxe 7f ち +null7 ア , then 


I 四 訓 sl 


with equality 下 and only ザ x = 7f ヵ . 


Proof 
(a) Suppose x と Then 
7 ァ ー5= (7 ァ ー77Tf の り +(77Tf ち の . 


The first term in parentheses above is in range 7. Because the operator 7TT 
is the orthogonal projection of W onto range ア [by 6.69(b) |, the second term 
in parentheses above is in (range7)~ [see 6.57⑪]. 


Thus the Pythagorean theorem implies the desired inequality that the norm of 
the second term in parentheses above is less than or equal to |7 ァ ー 多 , with 
eduality if and only if the frst term in parentheses above equals 0. Hence 
we have equality if and only f ャ ー7T ち と nul17, which is eduivalent to the 
statement thaty 7 ちょ null 了 ア 7, completing the proof of (a). 


(b) Suppose * と 7 ちょ null77 Hencex--7 ゆ ちと null ア Now 


ゝ ュ ン 


* ァ = マー7f の り +7 ち . 


The definition of 7T implies that 7TT5 (null7) 上 Thus the Pythagorean 
theorem implies that IT 別 < ll with equality 導 and only ザ x = 7T ヵ . 


A formula for 7「 will be given in the next chapter (see 7.78). 
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6.71 example: pe の o77verse の 7 6 7/77eg7 77GP 放 o77 FT 7o 


Suppose 7 了 と 々 (FE?) is defined by 
了 (2, り の,C。 の ) ニ (75+c.2c 二 0). 


This linear map is neither injective nor surjective, but We can compute its Dseudo- 
inverse. To do this, first note that range 了 = {(y,,0) : xy F). Thus 


Panee7( や の) ーー (Y,, 0) 
for each (r,y,z) と F* Also, 
null イ 7 ー 人 {( ヵ あの FE:g+ り +c ニ 0and 2c+gd=0). 


The Hist (一 1, 1,0, 0), (一 1, 0, 1, 一 2) of two Vectors in null 7 spans null 7 because 
i (4 か c, の null7 then 


( ゐ ヵ 5,c, の ) = 太一 1, 1, 0,0) + c( 一 1, 0, 1, 一 2). 


Because the list (一 1, 1, 0,0), (一 1, 0, 1, 一 2) is Hinearly independent, this list is a 
basis of null 7 
Now suppose (,,Z) 所 F3 Then 


6.72 7Tf( と の Z) = (Yan Pe7( ち め 2) = (Tn (もめ 0). 


The right side of the equation above is the vector (4 の ) F3 such that 
7(2,,c, の ) = (x, か 0) and (7, ちの (nul17)]. In other words, 4, 5, c, 9 must 
satisfy the following equations: 


7 十 り +C ニ アテ 


2c+ す 9 ニー ィ 
ーg7 二 りー= ニ 0 
ー7 二 c 一 27= ニ 0, 


where the first two equations are equivalent to the eduation 了 (4, ち ,c, の ) = (Y,7,0) 
and the ]ast two equations come from the condition for (2, ヵ ,c, の ) to be orthogo- 
nal to each of the basis vectors (一 1, 1, 0,0), (一 1, 0, 1, 一 2) in this basis of null 7. 
Thinking of yand? as constants and 2, り , c, as unknowns, we can solve the 
system above of four equations in four unknowns, getting 
7 三 征 (5z ー 2 の ), ちり = 証 (5x ー 2), c ニ 年 (メイ 4/), 9 = 年 (2x+ づり) . 
Hence 6.72 tells us that 
7f(x, ,Z) ニ 年 (5x ー 27, 5Y 一 27, 二 殺 /, 一 2 37). 


The formula above for 7「 shows that 77Tf (*, か 2) ニ (y, 0) for all (*,Z) と F3 
which illustrates the equation 77 キ ー aser from 6.69(b). 
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万 Ye7c7yey 6C 


1 Suppose の …, の, Prove that 
の,…, の エニ (span( の ,…。 の 。) ) 
2 Suppose is a subspace of with basis 7 ,… and 


On の 


is a basis of Prove that if the Gram-Schmidt procedure is applied to the 
basis of V above, producing a Host 66 放っ hen 6 …) 6 1S an 
orthonormal basis of 7 and 方 ,…, 万 is an orthonormal basis of リエ 


3 Suppose is the subspace of R* defined by 
= span((1,2, 3, --4), (一 5, 4, 3 2) ) . 
Find an orthonormal basis of and an orthonormal basis of て 


4 Suppose e」,…, 6 1S a Hst of vectors in with el| = 1 for each た = 1,.…, カ 
and 
2 2 
ll = ドキ エー キ ド の | 


forallo と V Prove that e」,…,e, 1S an orthonormal basis of / 


7775 ee7C7Se /7OV7des Co7Ve7Se 7 の 6.30( の ). 


S Suppose that Vis fimite-dimensional and is asubspace of Show that 
玉 エ ニナ リ ー 玉 ,, where 7 is the identity operator on 


6 Suppose is finite-dimensional and 7 と イズ 々 (V W). Show that 
了 アニ am7)+ 記 mae と 


7 Suppose that Xand Yare fimite-dimensional subspaces of / Prove that 
PP 用 =0andonly ザ (xy) =0forallxEXandalyeY. 


S Suppose is a finite-dimensional subspace of Vando と いじ Define a jinear 
functional の : リ っ ーFby 
の (4) 三 (⑰ ヵ の) 


forallz と U. By the Riesz representation theorem (6.42) as applied to the 
inner product space け , there exists a unidue vector の such that 


の (2) 三 ⑰。 の ) 
forallz U.Showthatw = 懇 / の . 


9 Suppose Vis finite-dimensional. Suppose P 々 ( ぴ ) is such that アデ ニア 
and every Vector in null P is orthogonal to every vector in range 刀 Prove 
that there exists a subspace U of such that ア ニテ ,. 


10 


11 


12 


13 


14 


15 


16 
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Suppose V is finite-dimensional and P と 々 () is such that P デ ニ pand 
IPgl < Il 
for every の と Prove that there exists a subspace (of Vsuch that ア =,. 
Suppose 了 々 () and Uis a finite-dimensional subspace of じ Prove that 
Uis invariant under 了 ーー ラル 7 ミイ. 


Suppose is finite-dimensional, 了 と ん ( り ), and is asubspace of Prove 
that 
7 and 太 ~ are both invariant under 7 っ アテ ミ 7 


SupposeF = R and Vis finite-dimensional. For eacho と Vlet の 。 denote 
the Hinear functional on defined by 
の 。(⑰) 三 (の) 


for allz と 


(&) Show thato 中 @。 is an injective linear map from V to 
(b) Use (a) and a dimension-counting aregument to show that の ら の 。1S an 
isomorphism from V onto ど " 


77e 7 の の ye の げ 75 ere7C/ye 7S 7 の ge 977 の 77e77777Ve の 7 の Oo/ の げ 77e が 7es< 
76/7@5@777977O7 77eo7e777 (6.22 7 6.58) we F = R. 77745 yo so7477 7 の 7 
4Se 77je 7ey< 76/76y677777O77 7776 の 76777 9 の 707 772 YO777 SO77477O7. 


Suppose that e」,…,6, 1S an orthonormal basis of じ Explain why the dual 
basis (see 3.112) of eg」,… 6 15 6 ,…, 6 Under the identification of V' with 
provided by the Riesz representation theorem (6.58). 


Im RS let 
= span((1, 1,0,0), (1, 1, 1, 2) ). 


Findz と suchthat llz 一 (1,2,3,4)| is as small as possible. 


Suppose C[ 一 1, 1] is the vector space of continuous real-valued functions 
on the interval [一 1, 1] with inner product given by 


1 
8) 7 
ー1 
forall/e と C[-1, 1]. Let U be the subspace of C[-1, 1] defned by 
= 人 (と C[-1,1] : (0) = 0). 


(4) Show that = {0). 
(b) Show that 6.49 and 6.52 do not hold without the finite-dimensional 
hypothesis. 
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1 
17 PFind ヵ 6 の (R) such that p(0) = 0, 7(0) = 0, and | 2 + 3x 一 p(?)| 7 is 
0 


as small as possible. 


18 Hind ヵ ググ 。(R) that makes 較 lsin*ー p(y)| に gr as small as possible. 


77e po の 7 の 77777 0.05 75 7 6rCe//e777 の の 7 の OX772777O77 7 の 7e 775W67 7 の 
er67C7Se, 777 7e7e YO 76 5 ん eg 7 の 7777 77e ergc7 sO7477 の 7 7 77DO/ ル ey 
の We7y C/ 7r. 4 co7 の 7@7 7 Cd727 677 の 7777 5Y77 の の 77c 77767 の 77 の 7 y77O747 の 
7e/. 


19 Suppose V is finite-dimensional andP 々 () is an orthogonal projecton 
of onto some subspace of Prove that pp 


20 Suppose Vis finite-dimensional and 子 と ん (W). Show that 
null7 キ ニー (range7)+ and ranee7f=(nul7)+ 
21 Suppose7 と (FE?,F^) is defined by 
了 (2, ち ,c) 三 (2 二 り +C,2 あ 30). 


(a) For (*,) と F< find a formula for rf (*, の). 

(b) Verify that the equation 7Tf = ranse7 TOm 6.69(b) holds with the 
formula for 7「 obtained in (8). 

(c) Verify that the equation 717 = Pam7)・ from 6.69(c) holds with the 
formula for 7「 obtained in (8). 


22 Suppose V is fimite-dimensional and 了 アー ん (W). Prove that 
UP an TU WT 


o77 27772472 の の ove c/eg77y 07/7 が 75 Ve777 の 7/e の ecg74ye 777 7777 Ce We 
cg7z 7ep7gce 7T iz アー 


23 Suppose and W are finite-dimensional and ア 7 ん (WV). Prove that 


(7 ニア 


77e e977 の 7 の の OVe 75 7 の 7 の 5 の 45 7 の 7776 7777 の 7 本 ニア が 7 7o/75 が 
了 が 5 772e77 の /e. 
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Chapter 7 匠 nd 
びり e777O7 ゞ O72 7777767 7 の 7C7 OPC6y 


The deepest results related to inner product spaces deal with the subject to which 
we now turn 一 linear maps and operators on inner product spaces. As we will see, 
good theorems can be proved by exploiting properties of the adjoint. 

The hugely important spectral theorem will provide a complete description 
of self-adjoint operators on real inner product spaces and of normal operators 
on complex inner product spaces. We will then use the spectral theorem to help 
understand positive operators and unitary operators, which will lead to unitary 
matrices and matrix factorizations. The spectral theorem will also lead to the 
popular singular value decomposition, which will lead to the polar decomposition. 

The most important results in the rest of this book are valid only in finite 
dimensions. Thus from now on we assume that and W are finite-dimensional. 


es Fdenotes R or C. 
s and W are nonzero fimite-dimensional inner product spaces OVer F. 


VS-A 9 998OlIW Je19d 


747e7 y9477@ 77 た yg C77 娘 d7 5 7 seve7 の / 7777265 の 7 の gy の ee72 77 SV67 の / 
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77O77 727yy75, 69726 7 の 205 の げ の 7297yy79 7 の S74 の y 7777776- の 777767257O7297 VeC7O7 PdC6S. 
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/4 Se た 人 47o777 7 の /Vo777777 /e777O7y 
Y//2///7 ん ) 


7.1 definitlon: g の o77 7 


Suppose7 と W). The 2 の oz of ア is the function 7*『: W っ such 
that 


(MO.00) 三 (の 060) 


for everyo と and every の IMW. 


1o see why the definition above 77e oO7 の 7 の 07777 725 の 77077767 77769727775 
makes sense, SuDposc 了 (WV W). Fix 77 7/77767 6/ge の 7 の . 777 CSe YO @77- 


の WW. Consider the linear functional CO77767 如 e yeco747 77eG777g 6/yey7e7e, 


の e 7776 77 777e の 776727778 ゞ 7/ の 7 


の > (7 の の 
0 g7 の 7777 の 76 772767476 7 の egC77 の 777e た 


on that maps の と リ to (7 の の ): this 

Hinear functional depends on 7 and p. By the Riesz representation theorem (6.42), 
there exists a unique vector in V such that this linear functional is given by taking 
the inner product with it. We call this unique vector 7Yzp. In other words, 7『oo is 
the unique vector in V such that 


7o, の ) = (の 77 の ) 


for everyo と V 

In the equation above, the inner product on the left takes place in W and the 
inner product on the right takes place in ". However, we use the same notation 
て ,・) for both inner products. 


7.2 example: gd7o77 7 6 772eg7 7 の 7o77 R? 7o 民 < 
Defne7:R3 っ RS<by 
了 (Y」, っ , Ya) ヒー (っ 十 づ Y。, 2Y。 ). 
To compute 7* suppose (x,*5,Y)  R? and (の, の ) RS Then 
(7 (Xi, っ , Ys), (ゆめ 2) ) = ((Y> + 3x*3。 2 ), (の, の) ) 
三 *2 が 」 二 3Xs7」 二 2Y1 の 
= ((, パ っ > 3 ), (2 め , ザ ] 3 ) 


The equation above and the definition of the adjoint imply that 


7 ド ( の の ) 三 (2 の , が 3) 
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7.3 example: の の Oo777 の 7 7776 の 7 7 の の 7777 777256 O/ の 777767257 の 77 の 7 7 の 7 1 


Fixz andxeMW.Defne 了 と バ ((W) by 
了 の ー (の ,77) そ 
for each ? と Tocompute 7* supposeo と andoe MW Then 
(7o, の ) 三 (〈@, 47), の ) 
ー (の , 47《Y, の ) 
三 (の ,( の , )7). 
Thus 


了 *Zp ー (の ,Y) 7. 


来 
In the two examples above, 7" turned 77e 7 の erd77 の /ey の ove 7 の 777e /7oo/ 
out to be not just a funnction from ピ tO jo se 2 co77zo7 7ec7777ge 767 


W but a linear map from to W. This co の 7 の 7 7 “5777 7777 の 7747 の 

behavior is true in general, as shown by ん (7o, の ) 万 e7 7 の 7e 7 7 の ge/ 

the next result. 7Ms7 o 7 7e ry7 57o7 娘 e ez が 7 如 e 
seco7 s/o7 w777 77e77 の e 7ToO. 


7.4 go7777 の 7 6 /77eg7 7 の 75 6 777697 7777 の 


TETーZ じ W),then 7* と の (WU). 


Proof Suppose7 と ズバ (WW). fo と り and zo」, の っ W then 
人 すけ の , の 」 十 の っ) 三 ( ナ の , の 1 ) 二 ( す の , の >) 
ニ (の 7To]) (の To ) 
= (の TTY の 7 の > ). 
The equation above shows that 
7*( の 」 二 の っ ) ニア *oo」 TO っ . 
fo と ん FE,andw 【W, then 
7o, Aro) = A(7o, の ) 
ニ A⑦⑫, 7*<o) 
ー (の , ATTo). 
The equation above shows that 
7*(Ap) = ATToo. 


Thus 7『 is a linear map, as desired. 
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7.5 7 の /e777ey o/ 777e 77o7777 


Suppose 7 古 々 (V W). Then 
(4) (5+ ア 7) ニー 5+ ア forall5 と WV): 
(b) (AT)* = 47*forall え AF: 


(⑳NO0 2 三 人 6 


(⑩ (57)*= ア 『S5* for all5 モ る (WW ) (here is a finite-dimensional inner 
product space Over ): 


(e) だ = where 7 is the identity operator on P: 


(⑪) ぜ 7is invertible, then 7* js invertible and (7 7) = (7 つう)* 


Proof Supposeo と VandweMW. 
(4) IE56 と 〆W), then 


((⑤ + ア ) の , の ) = (5 の , の ) + (7 の , の ) 
ー (の 5Yop) + (の , Tp) 
ー (の 5Yp Tp). 


Thus (5 + 了 ア )*o = ニ 5SYop 7 アテ 『o。 as desired. 


(b) ん FE,then 
((A7)o, の ) = A(7o, の) = A( の アテ op) = (の AT*Zo). 
Thus (A7)*co = A7*zp, as desired. 
(c) We have 上 
(7*zp, の ) (の, 7『 の ) = (7 の , の ) = (の , 7 の ). 
Thus (7*)"o = 7o, as desired. 
(⑨①) Suppose 5 と 々 (WO) andz  U. Then 


((S7)o, 4) = (5(7?), 4) = (Tp, 57Yz) = (の (5Y7) ). 
Thus (57)*, ニキ (5*), as desired. 
(e) Suppose z と Then 
(77 の) 三 (の). 
Thus ぜ o = の , as desired. 


(f) Suppose 7 is invertible. Take adjoints of both sides of the equation 7 アニ リア, 
then use (d) and (e) to show that ON TE = Similarly, the equation 
77ー| = 7implies (7ー) "7* ニー 了 7 Thus (7ー リ js the inverse of 7* as 
desired. 


IfF =R, then the map ア ニア jis a linear map from 々 (YY, W) to 々 (WW,), 
as follows from (a) and (b) of the result above. However, 下 F = C, then this map 
is not Hinear because of the complex conjugate that appears in (D). 
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The next result shows the relationship between the null space and the range of 
a hinear map and its adjoint. 


7.6 77 ypgce 72 の 777ge の 7 7 


Suppose 7 々 (V W). Then 
(&) null7* = (range7)~: 


(b) range 7* = (null7)~: 
(c) null ア 7 = (range7*): 
(④ range ア =(nul7*)-. 


Proof Webegin by proving (a). Let o  W. Then 
の null イド < の 富み =0 
* っ (の.7Po) 0forallo と アソ 
e う (7? の ) ニ 0foralloE 
* つ の (range7)~. 


Thus null7* = (range7)~, proving (8). 

Tf we take the orthogonal complement of both sides of (&), we get (①, where 
we have used 6.52. Replacing 7 with 7* in (a) gives (c), where we have used 
7.5(c). Finally, replacing 7 with 7* in (d) gives (b). 


As we will soon see, the next definition is intimately connected to the matrix 
of the adjoint of a linear map. 


7.7 definitlon: co7746d7e 7725 の の ye。 4 


The coz7zggfe 7g725POse Of an 7-by-7 matrix 4 is the 7-by-7 matrix 4* 
obtained by interchanging the rows and columns and then taking the complex 
conjugate of each entry. In other words, if 7 人 1, .…,7) and た た 人 (1, …77), 
then 


(2 2 


7.8 example: Co77gd7e 745 の OSe の / g 2- の y-3 77 


The conjugate transpose of the 2-by-3 
2 3+47 Z 
6 い ) 87 


が 2 7 が 77 人 4 2 7 の 7e/ e77776%, 
) is the 3-by-2 ez 4* ニー 4 7e7e 4「 7e7o7es 77e 

7775 の OSe の が 人 4 (77e 74d777 の /777e6 の 
の 777e7c/277729 77e 7Owy G7 の 77e 


2 6 fg の //7//7/AM』 
3ー47 5 。 


/ ー87 


matrix ( 


matrix 
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The nextresult shows howtocompute 7。 の on7 の g 7eg7 の oey 7O7 
the matrix of 7* from the matrix of 務 gepe の oz g coice の pgss. 77y 
Caution: With respect tO nonorthonor- rue ege77 が の ey が gsice go の / 
mal bases, the matrix of7* does notnec- eg 7 の PS 7797e の 7 79DOS6y Or 
essarily edual the conjugate transDOse Of cojzeg7e 7g775 の Osey の 7 7777Ce3. 
the matrix of 


7.9 7zg7 が ro7 7 アド eg4g/5 co774gd7e 7779DO56 の 7 772777Y の 7 了 ア 


Let 了 と 々 ん (\W). Suppose ,.…,6, 1S an orthonormal basis of V and 


方 ,…。 訪 , is an orthonormal basis of W. Then 77(7 (方,…, 刻 ),(,… 6 ) ) 
is the conjugate transpose of 7 ( 了 ,(,… 6), (方 ,…, 訪 ) ). In other words, 


MM ー (0000 


Proof In this proof, we will write 777) and 77(7*) instead of the longer 


expressions 77( 了 (6) (太っ 太 )) and 777 も (た, っ (っ 6) ) . 
Recall that we obtain the column of 77(7) by writing Te。 as a Hinear 
combination of the が si the scalars used in this linear combination then become 


the Acolumn of 77(7). Because 方, …, 方 1S an orthonormal basis of W, we 
know how to write Te as a Hinear combination ofthe が s [see 6.30(⑧)]|: 


Teg = (Ye 放浪 キー ト 6 訪 ) 訪 
Thus 
the entry in row /, column ん of (7) is (7e。 が 
In the statement above, replace 7 with 7* and interchange e」,…, ら 6, and 
方 訪 . This shows that the entry in row 7, column た of 77(7) is (だ ん た), 
which equals (ん , + ナ @), which equals (7e, 訪 ), which equals the complex conjugate 
of the entry in row た column of 27⑦). Thus 27(7*) = (27⑦)) 


The Riesz representation theorem as stated in 6.58 provides an identification of 
with its dual space V" defined in 3.110. Under this identification, the orthogonal 
complement ~ of a subset てこ corresponds to the annihilator U7 ofU.TTU 
is a subspace of then the formulas for the dimensions of ~ and become 
identical under this identification-see 3.123 and 6.51. 

Suppose 了 : ピー WisaHnear map. ecgz4se 77 の 5 の 77 CO77 の /67767275 7 の 
Under the identification of with "and g の os gre eg57er 7O deg7 2 太 の 7 
the identification of WW with W, the ad- zors の 7 g の 4/ 7 の 5, 777e7e が 5 
joint map7*: W ユーザ corresponds to ee 7o yo7k 7 放 の 廊 g7o7y 
the dualmap 7 W っ ツ defned in g77 7 7 の 77 7776 CO7276X7 の / 77776 ア 
3.118, as Exercise 32 asks you to Verify. yogc7 sgcey. 

Under this identification, the formulas for 

null7* and range7* | 7.6(a) and (b)| then become identical to the formulas for 
null7" and range7 [3.128(a) and 3.130(b)]. Furthermore, the theorem about the 
matrix of 7* (7.9) is analogous to the theorem about the matrix of 7" (3.132). 
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Se が -47o777 の O/e777 の 7y 


Now we switch our attention to operators on inner product spaces. Instead of 
considering linear maps from V to W, we will focus on linear maps from V to の : 
recall that such hnear maps are called operators. 


7.10 definition: se/ た go777 


An operator 了 三 々 ( じ ) is called se た 2 の of アー イキ 


f ず 7 と 々 () and g,…, ge, 1S an orthonormal basis of then is self-adjoint 
if and only if 77 (7 (eg)) = 77 (6 っ e0 as follows from 7.9. 


7.11 example: の e7e7777772g 7e77e7 了 7o ye が 2 の 7 の 777 万 O77 7 が 9 77777 


Supposec 三 Fand7 is the operator on F^ whose matrix (with respect to the 


standard basis) is 5 
李 
xo=(3 8) 


The matrix of 7* (with respect to the standard basis) is 


xy=( 3 


Thus 77 7) = 77(7『) 汗 and only ic = 3. Hence the operator ア is self-adjoint 
if andonly 半 c=3. 


A good analogy to keep in mind is that the adjoint on 々 ( じ ) plays a role similar 
to that of the complex conjugate on C. A complex number zis realand only 
ニタ: thus a self-adjoint operator (7 =?) is analogous to a real number. 

We will see that the analogy discussed opergforT の () fs se た go が 7 
above is reflected in SOme importamt PrOP- が gdon の が 
eriies of self-adjoint operators, beginning 
with eigenvalues in the next result. 

TIfF = KR, then by definition every rg/oo と 
eigenvalue is real, so the next result is 
interesting only whenF=C で . 


7?, の ) 三 (の ⑦, 了 の) 


7.12 e7ge7vg/7/esy の 7 ye/ た 7O7777 の の 67 の 7 の 7y 


Every eigenvalue of a self-adjoint operator is real. 


Proof Suppose 7 is a self-adjoint operator on じ Let ん be an eigenvalue of 了 , 
and let?be a nonzero vVector in V such that 7o = Ao. Then 


Allgl^ = (Ao,o) = (7o, の ) = (の , 7 の ) = (o, Ao) = Al に 


Thus A = 人 , which means that A is real, as desired. 
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The next result is false for real inner product spaces. As an example, consider 
the operator 7 と 々 (R^) that is a counterclockwise rotation of 90* around the 
origin: thus 7(,) = (一 ,). Notice that 7? is orthogonal toofor every o R^ 
even though 了 7 チ 0. 


7.13 7o 7 が so777ogo72g7 7O の /27 77 の < つ アミ 0(Gss777770gF ニ で CO) 


Suppose V is a complex inner product space and 7 々 ( ゆ ). Then 


(76, の) = 0foreveryo と どり < 呈 了 アテ 0. 


Proof THfz eo と then 
(7( み 二 の ),7 二 の) 一 ( 了 T( カ 7 一 の) 一 の ) 
4 
(7(z の),7 十 の) 一 (7( み 一 7 の ),7 一 ZZ の ) 
4 
as can be verified by computing the right side. Note that each term on the right 
side is of the form (7?,?) for appropriate の と WV 
Now suppose (To, の ) = 0 for everyo と V Then the equation above imples 
that 77 の ) = 0forall の と which then implies that7 ヵ =0foreveryzE 
(take ニ 了 カカ. Hence 7 = 0, as desired. 


77, の) ニ 


The next result is false for real inner 


旨 777e 77eX7 7657477 7OV7 の es 7 の 777e7 OO の 
product spaces, as shown by considering 


ed7 の /e o/ 7ow ye/ が -g7O7777 の 6777 の 7y 


any Operator on areal inner productspace pjZue /ke 7eg7 7 の es. 
that is not self-adjoint. 


7.14 (7o,?) 5 7eg7 7 g77 6 < の アア 7 が se 秦 2 が 2777 (4yy77777g F ー で C) 


Suppose V is a complex inner product space and 7 々 ( ゆ ). Then 


7 is self-adjoint < っ (7?, の ) 6 R for everyo の と 


Proof THfo と then 
7.15 (7*o, の ) = (の 7"o) = (7 の , の). 
Now 
7Tis self-adjoint < つ ア ー ザ =0 
e っ う (アー ザ 7)p, の ) = 0 for every の 
っ (72, の) 一 (7o, の ) = 0 for everyo の モア 
< つ (7?, の )  R for everyo と 


where the second equivalence follows from 7.13 as applied to アー ザ ド and the 
third equivalence follows from 7.15. 
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On areal inner product space anonzero operator 了 might satisfy (To, の ) = 0 
for all? と V However, the next result shows that this cannot happen for a self- 
adjoint operator. 


7.16 7 se た go777 7 の (7o, の ) 三 0767g77o < っ 了 アテ 0 


Suppose 7 is a self-adjoint operator on じ Then 


(7?, の ) = 0foreveryo と りり < 了 テ 0. 


Proof We have already proved this (without the hypothesis that 7 is self-adjoint) 
when V is a complex inner product space (see 7.13). Thus we can assume that レ 
is a real inner product space. IT の ヒル then 

(7(, 二 の ), な 7 寺 の ) 一 人 7( み 一 の ), ケ 一 の ) 


7.17 人 サカ が の) 三 ーーーーーー ニ ーー テーーー テ ーー 


as can be proved by computing the right side using the equation 
(7Z の 2) (の 本 2) 三 7 の ), 


where the frst equality holds because 7 is self-adjoint and the second equality 
holds because we are working in a real inner product sDace. 

Now suppose (To, の) = 0 for everyo ツ V Because each term on the right 
side of 7.17 is of the form (7?, o) for appropriate の , this implies that (7, の ) = 0 
for all ヵ wp と ツ V This implies that 7 = 0 for every y ヒ V(take の ニア 77). Hence 
了 ニ 0,as desired. 


/o77777 の の e777O7 ゞ 


7.18 definition: 77o7777/ 


e An operator on an inner product space is called 7o77g/ if it commutes with 
its adjoint. 


e In other words, 了 と 々 () is normal if 7 イキ ニー7 イ ポア 


Every self-adjoint operator is normal, because 下 了 is self-adjoint then 7 テニ アア 
and hence 7 commutes with 7 キ 


7.19 example: 7 67 の 7O7 77G7 79 7 の 077 の 7 の 7 7 の 7 Se が - の 7 の 777 


Let 7 be the operator on F* whose matrix (with respect to the standard basis) 


は っ) 


Thus 了 (zo, z) ニ (2<o 一 3z, 3 二 2Z). 


1S 


236 Chapter 7 Operators on Inner Product Spaces 


This operator is not self-adjoint because the entry in row 2, column 1 (which 
equals 3) does not equal the complex conjugate of the entry in row 1, column 2 
(which equals 一 3). 

The matrix of 7T* equals 


2 -3 2 3 13 0 
(: 2 )( _3 導 whkh edh [ 0 13 ) 


Similarly, the matrix of 7*7 equals 


2 3 2 -3 13 0 
( う 着 ( あ 2 ) which eah ( 0 13 ) 


Because 77* and 7*7 ア have the same matrix, we see that 77 テ = イア Thus 7 is 
normal. 


In the next section we will see why normal operators are worthy of special 
attention. The next result provides a useful characterization of normal operators. 


7.20 7 が 7o77ag7 が 7 の o7 の が To g7 の 7 To ye 娘 e y7776 7 の 7777 


Suppose 7 々 (). Then 


7 了 is normal < ol = IPYoll for every oe と 


Proof Wehave 
is normal < つつ 7 アー イイ =0 

< っ ((7 デ アー イイ や oe, の) = 0 for everyo と ア 
< っ (7*7o, の ) = (7T ザ の の ) for every の と 
< っ (7o, 7o) = (7To, To) for every の 
< っ ITol2 = 7*ol) for every o と 
e ラ ITol = IP for every o と 攻 

where we used 7.16 to establish the second equivalence (note that the operator 


7 アー7 ザ 7「 js self-adjoint). 


The next result presents several consequences of the result above. Compare 
(e) of the next result to Exercise 3. That exercise states that the eigenvalues of 
the adjoint of each operator are equal (as a set) to the complex conjugates of 
the eigenvalues of the operator. The exercise says nothing about eigenVectors, 
because an operator and its adjoint may have different eigenvectors. However, 
(e) of the next result implies that a normal operator and its adjoint have the same 
eigenVeCctOTS. 
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7.21 7472g@, 7277 の Ce, 77 67ge727VeC7O7y O/ の 77077727 の 6777O7 


Suppose 7 三 々 () is normal. Then 
(a) null7 =null 7 イキ: 


(b) range7 =range7 テ : 


(c) =null7@ ranee 了 7 
(① 7 ー 47 is normal for every ん  F: 
(e) ifo と and ん F.then 7o = oi and only if 7*o = Ao. 


Proof 
(a) Supposeo と Then 


onul7 選 上 引 =0 連 上 7P 引 =0 連 oenull7 


where the middle equivalence above follows from 7.20. Thus null7 = nul 7 
(b) We have 
range7 = (null7*) = (null7) エ = range 7 を 
where the frst equality comes from 7.6( す ), the second equality comes from 


(a) in this result, and the third equality comes from 7.6(b). 
(c) We have 


= (null7) @ (null ア 7) = null7@range7* ニ null ア 7@range 7, 


where the first equality comes from 6.49, the second equality comes from 
7.6(b), and the third equality comes from (b) in this result. 


(d 


ュ ン 


Suppose ル 6 F. Then 
7ーA47Dー470* ニ 7ーA7D(7*ー2D 
= ニ 77*ー 和 アー47* TA 
= ニア ザー アー47* TA 
=(7ーADー47 
= ザーA7)*7ー27). 


Thus 7 ー 47 commutes with its adjoint. Hence ア ー A7 is normal. 


(e) Suppose の and ん FE. Then (d) and 7.20 imply that 
II7ー47)gl = 上 7ーAD*al = 7*ー 27)a| 


Thus I7 - 47)gll = 0 王 and only 7* ー Ag| = 0. Hence 7o = Ao 主 
and only if7*o = ル o. 
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Because every self-adjoint operator is normal, the next result applies in partic- 
ular to self-adjoint operators. 


7.22  o77Ogo77g/ e7ge727VeC7O7 ゞ /O7 72O777777 O の 67 の 7 の 7 


Suppose 7 々 (げじ ) is normal. Then eigenvectors of 了 corresponding to 
distinct eigenvalues are orthogonal. 


Proof Suppose w,/ are distinct eigenValues of 7, With corresponding eigen- 
vectors 7 の. Thus 7z = zz and 7o = po. From 7.21(e) we have 7*o = po. 
Thus 


(w 一 8)(4。 の ) = (w の ) 一 (4 Bo) 
= (7 の ) 一 (4, 7 の ) 
= 0. 


Becausez 子 p, the equation above implies that (の ) = 0. Thus zandoare 
orthogonal, as desired. 


As stated here, the next result makes sense only when F = C. However, see 
Exercise 12 for a version that makes sense whenF=CandwhenF=R. 

SupposeF = Cand ア 7 と (ぴの ). Under the analogy between 々 () and C, 
with the adjoint on 々 () playing a similar role to that of the complex conjugate on 
C, the operators 4 and as defned by 7.24 correspond to the real and imaginary 
parts of 了 ア . Thus the informal title of the result below should make sense. 


7.23 了 ア 7 が 7o77247 を つつ 万 e 7eg/ 7 の 7777877277y 775 の 7 了 CoO7777777776 


SupposeF = Cand ア 7 と イィ Z( ゆ ). Then 7 is normal if and only i there exist 
commuting self-adjoint operators 4 and psuch that ア イニ 4+7. 


Proof Hirst suppose 了 is normal. Let 


7+ イ テ ーー 
7.24 2 旬 三 and = - 
27 
Then 4 and p are self-adjoint and 好 ニ 4+ 7 の . A quick computation shows that 
7* ア ー77 レ 
7.25 4p 一 4 = 2 


Because 7 is normal, the right side of the equation above equals 0. Thus the 
operators 4 and ぢ commute, as desired. 

To prove the implication in the other direction, now suppose there exist com- 
muting self-adjoint operators 4 and psuchthat( 了 ニー4+7.Then7 ザ ニス オー 妃 . 
Adding the ast two equations and then dividing by 2 produces the equation for 4 
in 7.24. Subtracting the last two equations and then dividing by 27 produces the 
eduation for pin 7.24. Now 7.24 implies 7.25. Because j and 4 commute, 7.23 
implies that 了 is normal, as desired. 
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re7c7yey / 人 ん 


1 


10 


Suppose 77 isS apositive integer. Defne 7 と 々 (FE7) by 
チ (Z]」…) 2 ) 三 (0。 2 … 2 ー ュ )- 
Find a formula for 7 テ (Z」,…Z,). 
Suppose 7 々 (V W). Prove that 
了 =0 之 =0 選 7 デミ 0 連 77#=0. 


Suppose 7 と 々 () and 往 FE. Prove that 

A is an eigenvalue of っ > Ais an eigenvalue of 7* 
Suppose 7 と 々 ( ゆ ) and Uis a subspace of / Prove that 

U is invariant under 7 < UT is invariant under 7 


Suppose 7 々 (V W). Suppose 6」, …,6, 1S an orthonormal basis of V and 
方 ,…, 方 1S an orthonormal basis of IW. Prove that 


ITelP+…+HTeP = 有 T 浪 ド +ー+ 7 浪 


77e 7777777 の e7y I7ei| spa ITe,l^ 777 万 e eg7427O77 の の ove の ee749 O77 77e O7777O- 
7 の 7777 の の 575 6 …。 6 の 47 7 が e 77g777 Se の 7 7e e9477O77 の の ey 7 の 7 の ee74 の の 7 
っ ら ・ 77745 万 e 6 の 77O72 の ove yowy 7 が 7 7e sz77 の 7 が e /6 7de oey 
7O7 の epe77 o7 777C77 の 777O7O77777 の 975 6] ,…。 6 75 7496 の . 


Suppose 了 と イィ (W). Prove that 

(&) is injective < つつ 7 デポ iS surjective: 

(b) ア is surjective < 7 ポ iS injective. 

Prove that if 了 7 アバ (W), then 

(a) dmnul7* = dimnull イ 7+dmW 一 dim : 
(b) dimranee7* = dimranse 7 


Suppose 4 is an 7-by-7 matrix with entries in F. Use (b) in Exercise 7 to 
prove that the row rank of 4 equals the column rank of 4. 


777y ere7C7Se の yy /7 ye7 7 の 77e7 77e777977Ve の 7 の の / の 7 9 7ey77 777 の y 
7eV7O7457Y の 7 の OU6g 777 う . う 7 g7 3.73. 


Prove that the product of two self-adjoint operators on is self-adjoint if 
and only i the two operators commute. 


SupposeF =Cand 了 T と ズバ ( ゆ ). Prove that 了 js self-adjoint if and only 下 
(7o, の) = (7『o, の ) 


forall? と 
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Define an operator 5 : F つ F2 by 5(<o,z) = (一 2, の ). 


(a) Find a formula for 5* 
(b) Show that S is normal but not self-adjoint. 
(c) Find all eigenvalues of 5. 


が F = R, 万 e7 5 se ope7g7o7 o7 R の / coz727e7C7ocK7se 7 の 27 が o77 の y 90". 
An operator p ん ( ぴ ) is called sew ザ 
テニ ーーp. 


Suppose that 了 と 々 ( じ ). Prove that is normal 導 and only if there exist 
commuting operators 4 and such that 4 is self-adjoint, is a skew operator, 
and7 ア ニス 4+p. 


SupposeF = R. Define プー 々 ( 々 ゆ )) by 27 チェア * for al 子 と る ( ゆ ). 


(a) Find all eigenvalues of . グ . 
(b) Find the minimal polynomial of ガ . 


Define an inner product on の 。(R) by (⑰,7) = 所 女 . Define an operator 
了 と (の (R)) by 
7(Z デ + 太 Tc) = 


(a) Show that with this inner product, the operator 了 is not self-adjoint. 
(b) The matrix of 7 with respect to the basis 1, ,y^ is 


0 0 0 
0 1 0 | 
0 0 0 


This matrix equals its conjugate transpose, even though 7 is not self- 
adjoint. Explain why this is not a contradiction. 


Suppose 7 と 々 ( ぴ ) is invertible. Prove that 
(a) 7is self-adjoint < っ 7 アー is self-adjoint: 
(b) 7 is normal < っ 7ー| is normal. 


SupposeF = R. 


(a) Show that the set of self-adjoint operators on V is a subspace of 々 ( げ ). 
(b) What is the dimension of the subspace of 々 () in (a) [in terms of 
dim |? 


SupposeF = C. Show that the set of self-adjoint operators on Visnota 
subspace of 々 ( ぴ ). 


Suppose dim ソ ッ > 2. Show that the set of normal operators on Visnot a 
subspace of 々 ( ぴ ). 
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Suppose 7 了 と 々 ( ゆ ) and 7*o|| < Ioll for everyo と Provethat7 is 
normal. 
777y ere7C7Se 7/5 の 7 777777776- の 777672S7O7767 777767 7 の の 74C7 5 の の CS, /eg7776 7 の 
27 7e Cg7/eg の 77O77727 の の @7 の 7 の 7$, 7 2ve 6 We77- の eve/opeg 777eo7y. 


Suppose P と 々 ( ツ ) is such that ア PS =P Prove that the following are 
eduivalent. 

(a) Pis self-adjoint. 

(b) Pis normal. 

(c) There is a subspace Uof ソ such that アー 玉 ,. 


Suppose り : Z。(R) っ グ の 。(R) is the differentiation operator defned by 
ヵ = が . Prove that there does not exist an inner product on グ 。(R) that 
makes リ り a normal operator. 


Give an example of an operator 了 と (R?) such that 了 is normal but not 
selt-adjoint. 


Suppose 7 is a normal operator on V Suppose alsothat の の リザ satisfy the 
eduations 
lgl = ll = 2. 7 の =32。 7 了 三 420. 


Show that IF(o+ oo)| = 10. 
Suppose 7 と 々 ( ぴ ) and 
0 寺 の 二 の 2 キー キー リャ 
is the minimal polynomial of 了 ア Prove that the minimal polynomial of 7* is 


4 


77/s ere7c7se sos 7 が 7 77e 777777777 PO/y7O7777 の 7 7 eg/5 77e 7 が 77777/ 
po/y7o77777 の 了 ザ ドニ RI. 


Suppose 7 々 ゆ ). Prove that 7 is diagonalizable if and only エア * is 
diagonalizable. 


Fix ヵ 。xV Defne 7 と 々 ( ぴ ) by 7o = (の の for everyo モ と 


(a) Prove that ザ ソ is a real Vector space, then 了 is self-adjoint if and only 
the list 。 yis Hinearly dependent. 
(b) Prove that ア is normal and only the Hist z,x is Hinearly dependent. 


Suppose 7 と 々 ( ぴ ) is normal. Prove that 
null7* ニ null7 and range7* ニ range 了 了 
for every positive integer た . 


Suppose 7 々 ( ツ ) is normal. Prove that if 人 , then the minimal 
polynomial of is not a polynomial multiple of (一 入 )^ 
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Prove or give a counterexample: T 了 と 々 () and there is an orthonormal 
basis 」,…,e6, Of such that ITeul = 7*eu| for each = 1,.…,7, then 7 is 
normal. 


Suppose that 7 (EE?) is normal and 7(1,1.1) = (2,2,2). Suppose 
(Z」,25, 2。) と null 7 Prove that z」 22 2Z ニテ 0. 


Fix a positive integer 7. In the inner product space of continuous real-valued 
functions on [一 7, 7] with inner product (た eg) = 7/g, let 


V = span(1, cos *, COs 2, .…,COS 7, Sin そ , Sin 2, .… S1n 7) . 


(a) Defne り と 々 ぴ ) by り / = が" Show that * = ニー リ . Conclude that り 
is normal but not self-adjoint. 
(b) Defne 7 と 々 ( ゆ ) by 77 = アデ. Show that is self-adjoint. 


Suppose 7: リー WisaHnear map. Show that under the standard identifica- 
tion of with の (see 6.58) and the corresponding identification of W with 
W? the adjoint map 7*: W ユーYcorresponds to the dual map 7 WM っ ". 
More precisely, show that 


7( の 。) ーー の 7*o 


for all の W where g,。 and の rr。。 are defined as in 6.58. 
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// Spec7g/ 777eo7e777 


Recall that a diagonal matrix is a square matrix that is 0 everywhere except 
possibly on the diagonal. Recall that an operator on is called diagonalizable if 
the operator has a diagonal matrix with respect to some basis of V Recall also 
that this happens if and only if there is a basis of consisting of eigenvectors of 
the operator (see 5.55). 

The nicest operators on V are those for which there is an o777o7o7772/ basis 
of with respect to which the operator has a diagonal matrix. These are precisely 
the operators 7 々 () such that there is an orthonormal basis of consisting 
of eigenvectors of 7 Our goal in this section is to prove the spectral theorem, 
which characterizes these operators as the self-adjoint operators whenF = Rand 
as the normal operators whenF =C. 

The spectral theorem is probably the most useful tool in the study of operators 
on inner product spaces. Its extension to certain infinite-dimensional inner product 
Spaces (see,。 for example, Section 10D of the author's book 7egyz7e, 7777e8777 の 7 
胡 eg/ 47g/yy7y) plays a key role in functional analysis. 

Because the conclusion of the spectral theorem depends on F, we will break 
the spectral theorem into two pieces, called the real spectral theorem and the 
complex spectral theorem. 


eg/ 5 の ec77/ 777eO7e777 


To prove the real spectral theorem, we will need two preliminary results. These 
preliminary results hold on both real and complex inner product spaces, but they 
are not needed for the proof of the complex spectral theorem. 

You could guess that the nextresultis 77:。 CO7iP/efD7g- 妨 6-9907e ei92e 
true and even discover its proof by think- pe Zseg fo eve 如 e 9 の gc 
img about quadratic polynomials with 7. 
real coefcients. Specifically, suppose 
jc と Rand デ <4c.Let rbe a real number. Then 


ちり ヽ 2 7 
ダ ++e=[ テ メ + > ) +(c-ー) >0 


In particular,* デ + rcis an invertible real number (a convoluted way of saying 
thatitis not0). Replacing the real number * with a self-adjoint operator (recall the 
analogy between real numbers and self-adjoint operators) leads to the next result. 


7.26 7ve777 の /e 74 の 7777C 6Y/7SS7O779 


Suppose 7 々 (D) is self-adjoint and ち c  R are such that 7 < 4c. Then 


72+7+g7 


is an invertible operator. 
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Proof Letobe anonzero vector in Then 
((72+ 7+c7Do, の ) = (72o, の ) + が の, の) 二 c( の , の ) 
= (7o,7o) + が 7o, の ) + cllgl" 
> IT 一 由 上 7ollllgll + clgl* 


22IN も 
= (ra - ) +(e-ー Jl 
ウ 2 4 


> 0, 


where the third Hine above holds by the Cauchy-Schwarz inequality (6.14). The 
last inequality implies that (7 テ + 7 + cg7)o 了 0. Thus 7 +7+c7 is injective, 
which implies that it is invertible (see 3.65). 


The next result will be a key tool in our proof of the real spectral theorem. 


7.27 77727777 の 7 の)7207777/ O/ se が -g7O7777 6777 の 7 


Suppose 7 々 () is self-adjoint. Then the minimal polynomial of 7 equals 
(z 一 41)…(z 一 4 ) for some A,.…, ん, 6 R. 


Proof First suppose F = C. The zeros of the minimal polynomial of 7 are the 
eigenvalues of ア [by 5.27(a)|. All eigenvalues of 7 了 are real (by 7.12). Thus the 
second version of the fundamental theorem of algebra (see 6.69) tells us that the 
minimal polynomial of 了 has the desired form. 

Now suppose F = R. By the factorization of a polynomial over R (see 4.16) 
there exist 4」,…, 和 ん, R and .….Pu。。…。cy  R with <4c。 for each 
such that the minimal polynomial of 7 equals 


7.28 (ターA1)…(Zー ル 4)(22+Z+)…(2 デ + が Z 二 CA): 


here either 77 or might equal 0, meaning that there are no terms of the corre- 
sponding form. Now 


人 = 才 De(7ー ル DTP Ta (02 よ も の ォ a の =0。 


fAM>0,then we could multiply both sides of the equation above on therisht by 
the inverse of7 テ + ム 子 + cA7 (which is an invertible operator by 7.26) to obtain a 
polynomial expression of that equals 0. The corresponding polynomial would 
have degree two less than the degree of 7.28, violating the minimality of the 
degree of the polynomial with this property. Thus we must have V =0, which 
means that the minimal polynomial in 7.28 has the form (z 一 1)…(z 一 ん ), as 
desired. 


The result above along with 5.27(a) impHies that every self-adjoint operator 
has an eigenvalue. In fact, as we will see in the next result, self-adjoint operators 
have enough eigenvectors to form a basis. 
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The nextresult, which gives a complete description of the self-adjoint operators 
on a real inner product space, 1S one of the major theorems in linear algebra. 


7.29 7eg/ spec77/ 777eo76777 


SupposeF = Rand7ー ン (げじ ). Then the following are equivalent. 


(a) is self-adjoint. 


(b) 7 has a diagonal matrix with respect to some orthonormal basis of 


(c) has an orthonormal basis consisting of eigenvectors of 7 ア . 


Proof Hirst suppose (a) holds, so 了 is seHf-adjoint. Our results on minimal poly- 
nomials, specifically 6.37 and 7.27, imply that ア has an upper-triangular matrix 
with respect to some orthonormal basis of / With respect to this orthonormal 
basis, the matrix of 7『 is the transpose of the matrix of 了 . However.7* = ア 
Thus the transpose of the matrix of 了 equals the matrix of 了 . Because the matrix 
of 7is upper-triangular, this means that all entries of the matrix above and below 
the diagonal are 0. Hence the matrix of ア is a diagonal matrix with respect to the 
orthonormal basis. Thus (a) implies (b). 

Conversely, now suppose (b) holds, so 了 has a diagonal matrix with respect to 
some orthonormal basis of That diagonal matrix equals its transpose. Thus 
with respect to that basis, the matrix of 7* equals the matrix of 7. Hence7* ニア, 
proving that (b) implies (a). 

The equivalence of (b) and (c) follows from the definitions |or see the proof 
that (a) and (b) are equivalent in 5.55 |. 


7.30 example: 72 07777O72O777797 の 579 0 げ 67ge77VeC7 の 7 / の 7 972 の の @7 の 7 の 7 


Consider the operator 7 on R? whose matrix (with respect to the standard 
basis) is 14 -13 8 
-13 14 8 |. 
8 8  -Z 


This matrix with real entries equals its transpose: thus 7 is self-adjoint. As you 
can Verify, 
(1, -1,0) (1, 1,1) (1, 1, 一 2) 
V2 vV8 ve 
is an orthonormal basis of R? consisting of eigenvectors of 了 ア . With respect to 
this basis, the matrix of 了 is the diagonal matrix 


27 0 0O 
0 9 0 | 
0 0 -15 


See Exercise 17 for a version of the real spectral theorem that applies simulta- 
neously to more than one operator. 
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Co777//er 5/ec77 777eO7e777 


The nextresult gives a complete description of the normal operators on a complex 
inner product space. 


7.31 co7//er y の ec7 の 7/ 77eo7e777 


SupposeF = Cand ア 7 々 (ゆり ). Then the following are equivalent. 
(a) 7is normal. 


(b) 7 has a diagonal matrix with respect to some orthonormal basis of 


(c) has an orthonormal basis consisting of eisenvectors of 7 


Proof Hirst suppose (a) holds, so 了 iS normal. By Schur's theorem (6.38), there is 
an orthonormal basis e」, …,e, Of withrespectto which ア has an upper-triangular 
matrix. Thus we can write 


9 1 の 拓 る 
7.32 27( 了 7, (6 ,…, 6 )) ニ … : 8 


0 ap 


We will show that this matrix is actually a diagonal matrix. 
We see from the matrix above that 


I7eiF ー la 
2 
IT*e ド = ロビ + 2 キー+ ha 記 


Because 了 is normal, Te = TTYe| (see 7.20). Thus the two equations above 
imply that all entries in the frst row of the matrix in 7.32, except possibly the frst 
entry 9」 」, edual 0. 

Now 7.32 implies 

I7e。IF 喧 lp 5 


(because g」 > 三 0, as we showed in the paragraph above) and 
ITYel' = lasP+ les ピ + ォ ー+ ks 直 

Because 7 is normal, |7e。| = 7“e|. Thus the two equations above imply that 

all entries in the second row of the matrix in 7.32, except possibly the diagonal 

entry > ぅ , edual 0. 

Continuing in this fashion, we see that all nondiagonal entries in the matrix 
7.32 equal 0. Thus (b) holds, completing the proof that (a) implies (b). 

Now suppose (b) holds, so 7 has a diagonal matrix with respect to some 
orthonormal basis of The matrix of 7* (with respect to the same basis) is 
obtained by taking the conjugate transpose Of the matrix of 7: hence 7* also has a 
diagonal matrix. Any two diagonal matrices commute: thus 7 commutes with 7 も 
which means that ア is normal. In other words, (a) holds, completing the proof 
that (b) implies (a). 

The equivalence of (b) and (c) follows from the definitions (also see 3.53). 
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See Exercises 13 and 20 for alternative proofs that (a) implies (b) in the 
preVious result. 

Exercises 14 and 1S interpret the real spectral theorem and the complex 
Spectral theorem by expressing the domain space as an orthogonal direct sum of 
eigenSDaCeS. 

See Exercise 16 for a version of the complex spectral theorem that applies 
simultaneously to more than one operator. 

The main conclusion of the complex spectral theorem is that every normal 
operator on a complex fimite-dimensional inner product space is diagonalizable 
by an orthonormal basis, as illustrated by the next example. 


7.33 example: 72 07777O72O777797 の 579 0 げ 67ge72VeC7 の 7 / の 7 972 の の @7 の 7 の 7 


Consider the operator 了 と /(C*) defined by 了 (,z) = (2 一 3z,3zo + 22). 
The matrix of ア (with respect to the standard basis) is 


2 -3 

3 2 / 
As we saw in Example 7.19, 了 is a normal operator. 

As you can verify, 
1 /, 届 あ 
誠 % J) 二 に 5 1) 

is an orthonormal basis of C^ consisting of eigenvectors of 7, and with respect to 
this basis the matrix of ア is the diagonal matrix 


2+37 0 
0 2-37 だ 


re7C7yey / ア 


1 Prove thata normal operator on a complex inner product space 1s self-adjoint 
if and only if all its eigenvalues are real. 


777o ee7C/ye S77677677e745 77e 7297Ogy (7 の 7 7 の 777777 の の @7 の 7 の 7 ゞ ) の evee72 Se が - 
g の O7777 O/67 の 7 の 7 7 76g/ 777477 の 675. 


2 SupposeF = C. Suppose 7 と 々 ( ぴ ) is normal and has only one eigenvalue. 
Prove that 7 is a scalar multiple of the identity operator. 


3 SupposeF=Cand 了 7 と 々 ( ゆ ) is normal. Prove that the set of eigenvalues 
of js contained in {0,1) 導 and only ithere is a subspace of Vsuch that 
了 三 族 ,. 


4 Prove that a normal operator on a complex inner product space iS skew 
(meaning it equals the negative of its adjoint) if and only if allits eigenvalues 
are purely imaginary (meaning that they have real part equal to 0). 
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Prove or give a counterexample: IfF 了 と (で?) is a diagonalizable operator 
then 7 is normal (with respect to the usual inner product). 


Suppose V is a complex inner product space and 7 ん () is a normal 
operator such that 7 ウェ 79 Prove that 7 is self-adjoint and 72 = アア 


Give an example of an operator 7 on a complex vector space such that 
0 3P huk 半 


SupposeF = Cand 了 と イズ (). Prove that 了 is normal if and only if every 
eigenvector of is also an eigenvector of 7 


SupposeF=Cand ア 7 と の ( ゆ ). Prove that ア is normal if and only ifthere 
exists a polynomial ヵ の (で ) such that 7 テニ p7). 


Suppose V is a complex inner product space. Prove that every normal 
operator on V has a square Toot. 


47 ope77o7 S  ( じ ) な な cg//ed 2 s927e 7 の 07 の 7 7 の (Y) が 52 = アア Me 
WZ7/ 7sC74y 77O76 の の 777 y7476 7 の 7 ゞ の / の Pe67 の 7 の 7 7 Sec77O77y /C 7 6C. 


Prove that every self-adjoint operator on has a cube root. 
4 ヵ ope7g7or 5 の (P) な cg7/7e7 2 cz の e 7oof の 7 7 の (V) が 59 = アア 


Suppose V is a complex Vector space and 7 ん ( ぴ ) is normal. Prove that 
if S is an operator on that commutes with 了 了 , then 5 commutes with 7 


777e 7ey7477 7 7775 ere7C/Se 75 Cg7/eg 7g7e7e '* 777eo7e777. 


Without using the complex spectral theorem, use the version of Schur's 
theorem that applies to two commuting operators (take ど = {7,7『) im 
Exercise 20 in Section 6B) to give a different proofthatifF= で Cand 
7 了 々 () is normal, then 7 has a diagonal matrix with respect to some 
orthonormal basis of 


SupposeF =Rand ア 7 と (ゆり ). Prove that 7 is self-adjoint if and only 
i all pairs of eisgenvectors corresponding to distinct eisenvalues of ア are 
orthogonal and ソ =5(4 7) 6 … @ E( 和 ん where A」, .…, ん 。 denote the 
distinct eigenvalues of 李 . 


SupposeF =Cand ア 7 と 々 ( ゆ ). Prove that is normalif and only 導 allpairs 
of eigenvectors corresponding to distinct eigenvalues of 了 are orthogonal 
and = 5(A」,7) @ … @ E( ん 4 ア )。 where 和 A」,.…, ん denote the distinct 
eigenvalues of 


SupposeF= ニ Cand ど て 々 (). Prove that there is an orthonormal basis 
of with respect to which every element of 〆 has a diagonal matrix if and 
only if Sand ア are commuting normal operators for al 5,7 と の. 
7777y ere7C7ye er7e747? 77e Co7 の 7er 5 の ec7/ 777eo7e777 7 の 77e CO77er7 の 7 の 
co//ec77O7 の 7 CO7777777777776 770777777 の P6777 の 7S. 
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SupposeF=Rand ど こん ( ゆ ). Prove that there is an orthonormal basis 
of with respect to which every element of 〆 has a diagonal matrix if and 
only if Sand ア are commuting self-adjoint operators for al 57 と のど . 


777s ere7C7se er7e7 の 5 777e 7eg/ spec7/ 娘 eo7e77 7 の 如 e co77eX7 の げ Co//ec7o7 
の co77772777772g ye が - の 7 の 7777 の の 7 の 7 の 7$. 


Give an example of a real inner product space , an operator 7 々 ( ぴ ), 
and real numbers ち c with 7 < 4c such that 


72+ 7+g/ 


is not invertible. 


777y ere7c7Se oy 777 77e が の oes7y 7 が 27 了 7o ye/ が た た do7777 Cd7777 の 7 の e 
ge/e7e 777 /.26, eve7 /27 76g/ Dec7O7 SDC@S. 


Suppose 7 と 々 () is self-adjoint and Uis a subspace of that is inVariant 
under 7. 

(a) Prove that U~ is invariant under 7 

(b) Prove that 7|, E 々 ( げ ) is self-adjoint. 

(c) Prove that 7 モ (て) is self-adjoint. 


Suppose 7 (げじ ) is normal and isasubspace of that is invariant 
under 7 ア . 

(&) Prove that Tis invariant under 7 

(b) Prove that is invariant under 7 

(c) Prove that (7I) = (7 ). 

(d) Prove that 7|, E 々 (7) and 7 (て ) are normal operators. 


77775 ere7C7Se C77 の e ye 7 の g7e ye@7 77O777e7 7 の の / の 77e co7 の er 5 の 6C77 の 7 
娘 eo7e77 (74e 772zc77O77 O77 dim V 7 の 77e 7es7477 27 7 29 7 67ge72VeC7 の 7). 


Suppose that 了 is a self-adjoint operator on a fimite-dimensionalinner product 
Space and that 2 and 3 are the only eigenvalues of 了 7. Prove that 


72ー57+67 =0. 


Give an example of an operator 7 と (で?) such that 2 and 3 are the only 
eigenvalues of7and72ー57+67 子 0. 


Suppose 7 と 々 () is self-adjoint, 4 F, and ec > 0. Suppose there exists 
Vsuch that |lgl| = 1 and 


ID 一 Agl| < e. 


Prove that 7 has an eigenvalue A'such that| オ えー ん 4| <e. 
7775 ee7C7Se SOwy 如 d7 /27 g ye が -g7O777 777 の 7 77 の e7 7777 75 C/Oye 
7 の yg7797 の 725 の 7 69777O77 7727 WO747 77 の ん e 77 77 676677V の 77e 75 C/Oye 7 の 977 
ん (2/4727///2 
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Suppose is a finite-dimensional vector space and7 と ズバ (D). 


(&) Suppose F = R. Prove that 了 is diagonalizable if and only there is a 
basis of U such that the matrix of 了 with respect to this basis equals its 
tranSDOSe. 

(b) Suppose F = C. Prove that ア is diagonalizable if and only 下 there is a 
basis of げ such that the matrix of 了 with respect to this basis commutes 
with its conjugate transDOSse. 


7775 ere7C/Se 9 74O777e7 e947V/e7Ce 7 の 777e /7S7 の 7 co7d777O74 ゞ 67777D の 76777 
79 g72go7g77zg の 777 が の 7 う . う 5. 


Suppose that 7 々 ( じ ) and there is an orthonormal basis e,…,e,。 Of 
consisting of eigenvectors of 了 , with corresponding eigenvalues 和 ん 」, … ん,. 
Show that 下 た 6 人 1, .…,77), then the pseudoinVerse 7f satisfies the equation 
1 / 
ェ e ぜん ルレ チ 0, 
rfe 
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/C /O5777ye の り e727 の 7y 


7.34 definition: の 5777e の の 67 の 7 の 


An operator 7 々 () is called posz が ve 下 了 is self-adjoint and 


(7?,?) > 0 


for allo と 


Vis a complex vector space, then the reduirement that ア be self-adjoint can 
be dropped from the definition above (by 7.14). 


7.35 example: の の 5777Ve の のり 67 の 7 の 7 


(a) Let 7  (F2) be the operator whose matrix (using the standard basis) is 
( 4 ). Then 7is self-adjoint and (( の ,z), (の, 2) ) = 2|el*ー2 Re(zoZ)+lz に 
=lo 一 2 に + | > 0for all (の ,z)  F<. Thus 7 is a positive operator. 

(b) Uisasubspace of then the orthogonal projection , is a Dositive operator, 
as you should verify. 

(c) 7 e 々 (D) is self-adjoint and ヵ ,c  R are such that の < 4c,then 72+ 7+Tc7 
is apositive operator, as shown by the proof of 7.26. 


7.36 definition: s97476 7 の 07 
An operator A is called a yg7e 7oo7 Of an operator 了 iR テニ アア 


7.37 example: 59d76 7 の 7 の げ 7 72 の の @7 の 7 の 7 


IF 7  (E?) is defined by 了 (2],25, ZS) 三 (2。,0,0), then the operator 
AR と (FE?) defined by K(Z」,2o,Z。) 三 (2, Zs,0) 1s a square root of 7 because 
AR ニア , as you can Verify. 


The characterizations of the posiHive ecg4ye の OS777Ve の の 6777 の 7 CO776 の の 7 の 
Operators in the next result corresPond 77O7726977Ve 727770 の 67y, の 67767 7677777- 
to characterizations of the nonnegatHiVe opgy oz/ se 放 e 7e777 7 の 66 が 
numbers among C. Specifically, a num- operg7ors. 万 owever Ope7g7O7 娘 eo775 が 5 
berz Cisnonnegative if and only co72 ゞ 7S76777) cg// 777eye OS777e の 67 の - 
i it has a nonnegative square TOOt, COT- 7o7s, so we 72/7ow 万 27 cy7O77. SO776 
responding to condition (d). Also, ziS 7 が e7227c72729 745e 7e 767772 の の 577Z6 
nonnegative if and only ifithasareal se7zZ7e77776 の の 677O7。 77C7 776g72S 
square root。 corresponding to condition es2726 95 OS77ZVe の Pe747 の た 
(@). Finally, z is nonnegative if and only 
there exists の C such that z = の の , corresponding to condition (⑪). See 
Exercise 20 for another condition that is equivalent to being a positive operator. 
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7.38 Cc/7c7677<77O77 の / OS777Ve O/6777O7 ゞ 


Let 7 々 ( じ ). Then the following are equivalent. 
(a) 了 is a positive operator. 


(b) 7 is self-adjoint and all eigenvalues of 7 are nonnegatiVe. 


(c) Withrespect to some orthonormal basis of V the matrix of ア is a diagonal 
matrix with only nonnegative numbers on the diagonal. 


(① 7 has a positive square root. 
(e) 7 has a self-adjoint square root. 


(DD アニ RYRfor some RE の (ぴの ). 


Proof Wewill prove that (4) ラ (b) ラ (CcC) ラ (ララ (⑥) ラ ⑪ ラ (@). 

First suppose (a) holds, so that is positive, which implies that is self-adjoint 
(by definition of positive operator). To prove the other condition in (b), suppose 
Ais an eigenvalue of 了 7. Leto be an eigenvector of 了 corresponding to ん . Then 


0 < (7?, の ) ニ (の, の ) 三 4(@, の ). 


Thus ル is a nonnegative number. Hence (b) holds, showing that (a) implies (b). 

Now suppose (b) holds, so that ア is self-adjoint and all eigenvalues of are 
nonnegative. By the spectral theorem (7.29 and 7.31), there is an orthonormal 
basis e」, …,e, Of V consisting of eigenvectors of 了 7. Let A」, …, ん , be the eigenval- 
ues of 了 corresponding to e」,…,6: thus each ル , is a nonnegative number. The 
matrix of 了 with respect to e」, .…, 6 1S the diagonal matrix with A」,…, ん 。 on the 
diagonal, which shows that (b) implies (c). 

Now suppose (c) holds. Suppose e」,…,e。 1S an orthonormal basis of V such 
that the matrix of with respect to this basis is a diagonal matrix with nonnegative 
numbers A」, .…, ん ル ん, on the diagonal. The Hinear map lemma (3.4) implies that 


there exists R (げじ ) such that 


Ke = y 人 Are 

for each た = 1,.…,77. As you should verify, is a positive operator. Furthermore, 
AR2e, = Azer = 7er for each た which implies that が < ニア Thus Ris apositive 
square root of 7. Hence (d) holds, which shows that (c) implies (9d). 

Every positive operator is self-adjoint (by definition of positive operator). 
Thus (d) implies (6). 

Now suppose (e) holds, meaning that there exists a self-adjoint operator R on 
such that 7 = R2 Then 了 ーRF*R (because * = 尺 ). Hence (e) implies (⑪. 

Finally, suppose (f) holds. Let R と 々 ( じ ) be such that 了 = RFR. Then 
7 キー (RYR)) = RY(R*) = RYR ニア Hence 7 了 is self-adjoint. To complete the 
proof that (a) holds, note that 


(7o, の ) = ニ (R*Ro,?) (Ro, Ro) > 0 
for everyo と V Thus 7 is positive, showing that ) implies (a). 
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Every nonnegative number has a unique nonnegative square root. The next 
result shows that positive operators enjoy a similar property. 


7.39 egc/, Os777Ve の の @7 の 7O7 7 の 9 の 7 O726 OS77Z7De の 77776 7 の 07 


Every positive operator on V has a umidue Dositive square root. 


Proof Suppose 7 ズ () iS posiHVe. 4 OS777e の Pe77 の 7 Cg7 ve 7277777e/ 
SuPPOSe o 所 ViS an eigenVector of 了 。 訪 Zy gg7e 7oo7s (Ge o7/ の ze 
Hence there exists a real number ル >  // 太 ecg e pos7e). fo7 erg77 の と, 
Such that 7 ゥ Ao. 如 e7e777 Ope727O7 7 V 7 太 放 7 

Let be a positive square root of 子 。 訪 Zzzy sgg7e 7oo な が dim リ >1. 

We will prove that Ro = VAo. This wi 

imply that the behavior of A on the eigenvectors of 7 is uniquely determined. 
Because there is a basis of "consisting of eisenvectors of 了 (by the spectral 
theorem), this will imply that is uniquely determined. 

TO prove that Ro = Y Ao, note that the spectral theorem asserts that there is an 
orthonormal basis e」,…,e, Of consisting of eigenvectors of KR. Because Risa 
positive operator, all its eigenvalues are nonnegative. Thus there exist nonnegative 
numbers 人 …, ル ん, Such that Ke, = Ve for each = 1, …,7. 

Because e」, …, 6, 1S a basis of we can write 


の 三 丁 二 … 二 の 6 


for some numbers 2」, .…, 2 三 F. Thus 
Ko = g1 ソ Are」 キオ … 二 の .V ん 


Ao = 7 ゥ = Ro =ーg1 人 An キー ん 6 


Hence 


The equation above implies that 
人 6] キー 寺本, 三 人 416 キー… 二 本 ん 
Thus (ん ー ん /) = 0 for each た = 1,.…,77. Hence 
人 : 太 = 
Thus 
AA の ニ 2 gz VAer 三 YAo。 


(ik=2 
as desired. 


The notation defined below makes sense thanks to the result above. 


For 7 a positive operator, V7 denotes the unique DositiVe square root Of 李 
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7.41 example: 974 の 76 7 の O7 の げ の 5777De の の @7 の 7 の 7 ゞ 


Define operators 5,7 on R* (with the usual Buclidean inner product) by 
S(*,) ニ (,27) and 了 了 (の ニ (テキ テオ の). 
Then with respect to the standard basis of R< we have 


7.42 ⑤ =[ 痢 and の =[ : ボ 


Each of these matrices equals its transpose: thus 5S and ア are self-adjoint. 
T (y,y) 6 R2<, then 
(S(y, の , (Y,7)) = * テ +277 >0 


and 
(7(%7,(7 の )) ニダ ディ 2 テ xy+7 ケ ニ (+7 の >0. 


Thus 5 and 7 are positive operators. 
The standard basis of R2 is an orthonormal basis consisting of eigenvectors of 


5. Note that 
下品 1 ED 
(なあ 2 


is an orthonormal basis of eigenvectors of 了 , with eisgenvalue 2 for the frst 


eigenvectors。 With eigenvalues V2 and 0. 


eigenvector and eigenvalue 0 for the second eigenvector. Thus V7 has the same 
You can verify that 
1 0 


が 5) = ( 。  」 and yG の )-| 較 
Y2 


with respect to the standard basis by showing that the squares of the matrices 
above are the matrices in 7.42 and that each matrix above is the matrix of a positiVe 
Operator. 


iaSila 


The statement of the next result does not involve a square root, but the clean 
proof makes nice use of the square root of a positive operator. 


7.43 了 アカ os77ve g77 (7 の の ) =0 7% み =0 


Suppose 7 is a positive operator on ando リ is such that 7 の) = 0. 
Then 7o = 0. 


Proof Wehave 
0 = (7?, の ) = ニ (VTV7o,2) 王 (V7o, V7o) 三 |IVY| 


Hence V7o = 0. Thus 7o = V7( V7o) ー 0,as desired. 
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re7c7yey /C 


10 


11 


12 


Suppose 7 と 々 ( ゆ ). Prove that if both 7 and 7 了 are positive operators, then 
アア =0. 


Suppose 7 了  (F*) is the operator whose matrix (with respect to the 
standard basis) is 


2 -1 0 0 
ー-1 2 -1 0 
0 -1 2 -1 
0 0 -1 2 


Show that 7 is an invertible positive operator. 


Suppose 7 iS a DOsitiVe integer and 7 々 (F”) is the operator whose matrix 
(with respect to the standard basis) consists of all 1's. Show that 了 isa 
OSitive ODerator. 


Suppose 7 is an integer with ヵ > 1. Show that there exists an 7-by-7 matrix 
4 such that all of the entries of 4 are positive numbers and 4 = 4* but the 
operator on F”" whose matrix (with respect to the standard basis) equals 4 is 
not a DOS1HVe ODeratOr. 


Suppose 了 々 (V) is self-adjoint. Prove that 了 is a positive operator if and 
only if for every orthonormal basis e」, .…,e, Of V all entries on the diagonal 
of 7(, (6 ,.…,e。) ) are nonnegatiVe numbers. 


Prove that the sum of two positive operators on げ is a Dositive operator. 


Suppose S 々 ( ぴ ) is an invertible positive operator and 了 7 と 々 (V) is a 
positive operator. Prove that 5 エ 了 is invertible. 


Suppose 7 と 々 ( り ). Prove that is a positive operator if and only 下 the 
DSeudoinVerse 7TTisa POSitive ODerator. 


Suppose 7 々 () is a positive operator and 5 (WW, ぴ ). Prove that 
S*7S is a positive operator on WW. 


Suppose 了 is a positive operator on Suppose の, の ヒザ are such that 
7o= ニ の and 7 の = の 
Prove thato= ィ の . 


Suppose 7 is a positive operator on "and is asubspace of invariant 
under 了 . Prove that | モ 々 ( け ) is a positive operator on /. 


Suppose 7 と 々 ( じ ) is apositive operator. Prove that 7* is a positive operator 
for every positive integer た . 


2S6 


13 


14 


15 


16 


17 


18 


19 


20 


21 
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Suppose 7 と 々 ( ゆ ) is self-adjoint andwR. 

(a) Prove that ア ー war7is a positive operator if and only if w is less than or 
edual to every eigenvalue of ア 

(b) Prove that リー iS a positive operator i and only if z is greater than or 
edual to every eigenvalue of ア . 


Suppose 了 is a positive operator on "and の 」,…, の , ビ V Prove that 


777 777 


〉. 2 人 7? の ,) > 0. 


= 1 た =1 
Suppose 7 々 (げじ ) is self-adjoint. Prove that there exist positive Operators 
4, () such that 

アー ニ 4ーB and V7*7 ニ A+ and 4B ニ BA= ニ 0. 
Suppose 7 is a positive operator on V Prove that 


nullV7 ニ null7 and rangeV7 ニ range7 ア 


Suppose that アビ 々 ( ツ ) is a positive operator. Prove that there exists a 
polynomial ヵ with real coefcients such that V7 = p(7). 


Suppose S and 7 are positive operators on じ Prove that 57 is a positive 
operator i and only if 5 andTcommute. 


Show that the identity operator on F* has infinitely many self-adjoint square 
TOOtS. 


Suppose 了  () and e」 , …,e, 1 an orthonormal basis of / Prove that 了 
is a positive operator if and only there exist の 」, …, の, 三 V such that 


(76 の) (の 。 の ) 
for all た = 1 …,7. 


77e 7 の e7y (76 の 7 ナ ニュ ーー。 の 76 が e e777ey 7 7e 77g が 7 び 了 wi が 
76$/@C7 7 の 7e O7777O77O777297 575 6] …。 6 


Suppose 7 1S a Dositive integer. The 7-by-7 ヵ 万 7 の e77 7 の 7 克 1S the 7-by-7 
matrix whose entry in row /, column Kis ae Suppose 了 々 () is an 
operator whose matrix with respect to some orthonormal basis of is the 
7-by-7 Hilbert matrix. Prove that 了 is a positiVe invertible operator. 


7g7 の /e: 77e 4- か y-4 右 7/ の e77 7 が 7 75 


1 1 1 
1 z s 4 
7 和 、 人 
の 4 3 4 5 
Ii、 芝 
3 4 5 6 
由伸 8 
4 5 6 Z 


22 


23 


24 


25 
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Suppose 7 々 ( ぴ ) is a positive operator andz is such that | = 1 
and 7 > 7ol for allog と with lgl| = 1. Show that 7 is an eigenvector 
of ア corresponding to the largest eigenvalue of ア | 


For 了 と る ( ゆ ) and の と defime (の )+ by (4 の 7 = (7 の ). 


(&) Suppose 7 了 と 々 ( ゆ ). Prove that (-, 7 1S an inner product on 語 and 
only エア is an invertible positive operator (with respect to the original 
inner product (・,・)). 

(b) Prove that every inner product on is of the form (,・)+ for some positiVe 
invertible operator 7 々 ( ぴ ). 


Suppose 5 and 了 are positive operators on V Prove that 
null(5 + 了 ア ) = ニ null5nnull 好 


Let 了 be the second derivative operator in Exercise 31(b) in Section 7A. 
Show that - 了 is a positive operator. 
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/ の /o77e77es, 077727y Ope727 の 75, 777 ル 7277 77O77Z77O77 


が バ O77767776y 


Linear maps that preserve norms are suffciently important to deserve a name. 


7.44 definition: 75O776 ケ y 


A jnear map S と (WW) is called an oo7ze が 7 下 
ISgll = | 


for everyo と ツ In other words, a linear map is an isometry if it preserves 
norms. 


If5 と (WW) is an isometry and 


777e O7ee ん oO77 7SOy 7776775 697477, 777e 
Vis such that So = 0, then 


で 7ee ん た の 7 の 77767077 77769725 77763777 ぞ . 
lgll = ISgll = IOI = 0, 77745 750726 が がり /77e777) 7776725 67740/ 


777 ど 7 ゞ 777. 
which implies thato = 0. Thus every 


isometry 1S injectiVe. 


7.45 example: o777 の 7 の 77727 の 975 7777 の 5 7 の O7777 の 7O77797 /757 ーー 7 が 5 の 7267y 


SuDDOSe 6 , …, 6 1S an Orthonormal basis of P and g」, …,@,, 1S an orthonormal 
jist in W. Let 5 と (WW) be the Hinear map such that Se = g, for each 
た = 1,…,7. To show that 5 is an isometry, supposeoV Then 


7.46 の 三 (の ,e176」 二 … 十 ( の 6, 676。 
and 

2 2 2 
7.47 le トー+ ド og 汗 


where we have used 6.30(b). Applying 5 to both sides of 7.46 gives 
So 三 (の , e1)5e] 十 … 十 (の , 6。)56」 三 (の , 61 72] 二 … 十 (の , 76. 

Thus 

7.48 ISgl2 = o+ キー+ ド og) 尼 


Comparing 7.47 and 7.48 shows that |lgl| = ISgll. Thus 5 is an isometry. 


The next result gives conditions equivalent to being an isometry. The eduiV- 
alence of (a) and (c) shows that a jinear map is an isometry if and only it 
preserves inner products. The equivalence of (a) and (d) shows that a Hinear map 
is an isometry if and only 症 it maps some orthonormal basis to an orthonormal list. 
Thus the isometries given by Bxample 7.45 include all isometries. Furthermore, 
a Hinear map is an isometry if and only if it maps every orthonormal basis to an 
orthonormal list [ because whether or not (a) holds does not depend on the basis 


es ら 直 
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The equivalence of (a) and (e) in the next result shows that a hnear map is an 
isometry if and only the columns of its matrix (With respect to any orthonormal 
bases) form an orthonormal list. Here we are identifying the columns of an 娘 -by-7 
matrix with elements of F" and then using the Euclidean inner product on F". 


7.49 CZ7c7677<77O77 の / 7O77767776y 


Suppose 5 三 々 (V W). Suppose e」, .…, 6, 1S an orthonormal basis of V and 
方, …, 訪 , 1S an orthonormal basis of WW. Then the following are equivalent. 


(a) 5 is an isomeftry. 
(b) 5*S = 了 7 
(c) 〈57, 65 の) = ニ (4 の ) for all の と 


(d) Se, .…, 5e, 1S an orthonormal list in W. 


(e) The columns of (5,(,… 6),( 訪 , …, 訪 ) ) form an orthonormal list 
in F" with respect to the Buclidean inner product. 


Proof First suppose (a) holds, so 5 is an isometry. fo の とり then 
(0 - 5*5)p, の ) = (⑫ の 一 (5*So, の ) = Hg" - (5o, 8 の ) = ll ドーISgl7 =0. 


Hence the self-adjoint operator7ー S*S equals 0 (by 7.16). Thus 9*S = ニ 了 proving 
that (a) implies (b). 
Now suppose (b) holds, so 5*S = 了 Hf の と then 


(5z。。 5o) = (5* 5 の) = 7, の ) 三 (4 の), 


proving that (b) implies (c). 
Now suppose that (c) holds, so (5z, 5 の ) = (7 の) for all 4 の モザ Thus 議 
ヵ た 6 1, …, 7), then 
(5e, Ser) ニ (@, 2 
Hence 5e」, …, Se 1S an orthonormal Hst in W, proving that (c) implies (d). 
Now suppose that (d) holds, so 5e」, .…, Se, is an orthonormal list in W. Let 
4 ステ 7(5.(」 6 の), (方, …) 方 )). た 7 人 1 .…,7), then 


反 婦 7 1 語 た ニア 
7.50 2 0 ーー (% 02/ ば 2 4 ん の) (5er, Se ) トー 。 ぜん ょ 


The left side of 7.50 is the inner product in F" of columns た andr7 of 4. Thus the 
columns of 4 form an orthonormal list in F"。 proving that (d) implies (@). 

Now suppose (e) holds, so the columns of the matrix 4 defined in the paragraph 
above form an orthonormal Hist in F". Then 7.50 shows that 5e」, …, 5e, is an 
orthonormal list in W. Thus Example 7.45, with 5e」, ……, 5e, playing the role of 
っ Shows that S is an isometry, proving that (e) implies (8). 


See Exercises 1 and 11 for additonal conditions that are equivalent to being 
an isometry. 
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(077777y ひ /e747 の 7 ゞ 


In this subsection, We confine our attention to linear maps from a vector space to 
itself. In other words, we will be working with operators. 


7.51 definition: 77777y の の 67 の 7 の 


An operator 5 々 (V) is called zz が 27y せ S is an invertible isometry. 


As previousIy noted, every isometry 47ogp 万 e words "2 の gz の 
is injective. Every injective operator on “7so7fe7y” 7ieg77 太 e sg7e 太 g 7 
a finite-dimensional VectOr SDace iS in- ope7g7ors o7 放 7e- の 77e7s7Og7 77e7 
vertible (see 3.65). A standing assump- 7 の 74C7 5 の の C65, 7@7776777 の 67 77727 の 7777- 
tion for this chapter is that is a finite- 7 ope77O7 272PS の VeC7O7 SgCe 7 の 
dimensional inner product space. Thus 7 が se が we 7 5 の 776 が 742Dy の VeC7Or 
we could delete the word “invertible” spgce 7o gzo7e7 (poss7 の の の 7e7 の ) 
from the definition above without chang- Vec/O7 PCe. 
ing the meaning. The unnecessary word 
“invertible” has been retained in the definition above for consistency with the 
definition readers may encounter when learning about inner product spaces that 
are not necessarily finite-dimensional. 


7.52 example: 7o7Z7o7 の 7 R< 


Suppose 9  R and Sis the operator on F2 whose matrix with respect to the 


standard basis of F< is 
cos の 一 sin の 9 
sin の 9 cos の 9 / 


The two columns of this matrix form an orthonormal list in F2: hence S is an 
isometry [by the equivalence of (a) and (e) in 7.49]. Thus S is a unitary operator. 

Tf = R, then S is the operator of counterclockwise rotation by 9radians 
around the origin of R^. This observation gives us another way to think about why 
S is an isometry, because each rotation around the origin of R2 preserves norms. 


The next result (7.53) Hists several conditions that are equivalent to being a 
unitary operator. All the conditions equivalent to being an isometry in 7.49 should 
be added to this list. The extra conditions in 7.53 arise because of limiting the 
context to Hinear maps from a vector space to itsef. For example, 7.49 shows that 
alinear mapS5 モ と W) is an isometry if andonlyif5*S = ニ 了 while 7.53 shows 
that an operator 5 三 々 () is a unitary operator if and onlyifS*S ニ 55* ニア 

Another difference is that 7.49(d) mentions an orthonormal list, while 7.53(d) 
mentions an orthonormal basis. Also, 7.49(e) mentions the columns of 7 7), 
while 7.53(e) mentions the rows of 7(7). Furthermore, 77 (7 ) in 7.49(e) is with 
respect to an orthonormal basis of and an orthonormal basis of W, while 7 (7) 
in 7.53(e) is with respect to a single basis of doing double duty. 
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7.53 CZ7C7677<77O77 の / 7727777y O の 677O7 ゞ 


Suppose 5 々 ( じ ). Suppose e」, ……, 6, 1S an orthonormal basis of / Then the 
following are equivalent. 


(a) 5 is a unitary operator. 


(DMR9S ョ 5952 三 


(c) S is invertible and 5-! = 5* 


(すむ) 56」, .…, 5e, 1S an orthonormal basis of 


(e) The rows of 77(S,(e」,.…,g,)) form an orthonormal basis of F" with 
respect to the Buclidean inner product. 


(⑪) 5* isS a unitary operator. 


Proof First suppose (a) holds, so 5 is a unitary operator. Hence 
co 一 | 


by the equivalence of (a) and (b) in 7.49. Multply both sides of this equation by 
5-} on the right, getting 5* = 5-!. Thus 55* = SS5-} =, as desired, proving 
that (a) implies (b). 

The definitions of invertible and inverse show that (b) implies (c). 

Now suppose (c) holds, so S is invertible and 5-! = 5* Thus 5*5S ニ 7. Hence 
Se], …, Se 1S an orthonormal list in by the equivalence of (b) and (d) in 7.49. 
The length of this list equals dm V Thus Se , .…, 5e,, is an orthonormal basis of 久 
proving that (c) implies (9d). 

Now suppose (d) holds, so 5e」, .…, Se, 1s an orthonormal basis of The 
eduivalence of (a) and (d) in 7.49 shows that 5 is a unitary operator. Thus 


(9*?)*9* = 59* ニル 


where the last equation holds because we have already shown that (a) implies (b) in 
this result. The equation above and the eduivalence of (a) and (b) in 7.49 show that 
S* is an isometry. Thus the columns of 27 (5 も (gg) ) fOrm an orthonormal ba- 
sis of F" [by the equivalence of (a) and (e) of 7.49]. The rows of 7 (5, (e」,.…,6。) ) 
are the complex conjugates of the columns of 77(5 も (6」,……)e。) ). Thus the rows 
of 77(S, (e」, .…,e。) ) form an orthonormal basis of F"。 proving that (d) implies (e). 

Now suppose (e) holds. Thus the columns of 77(5 も (eg,…,g)) form an 
orthonormal basis of F". The equivalence of (a) and (e) in 7.49 shows that 5* is 
an isometry, Droving that (e) imples (⑪. 

Now suppose (f) holds, so 5* is a unitary operator. The chain of implications 
we have already proved in this result shows that (a) implies ⑪. Applyings this 
result to 5* shows that (5*)~ is a unitary operator, proving that () implies (a). 

We have shown that (a) ラ (b) = (c) ラ (d) ラ (@) = ⑪ = (⑧), completing the 
proof. 
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Recall our analogy between C and 々 ( ぴ ). Under this analogy, a complex 
number z corresponds to an operator 5 と (の), andz corresponds to 5*. The 
real numbers (z ニタ ) correspond to the self-adjoint operators (5 = 5*), and the 
nonnegative numbers correspond to the (badIly named) positive operators. 

Another distinguished subset of C is the unit circle, which consists of the 
complex numbers z such that |z| = 1. The condition |z| = 1 is equivalent to the 
condition zz = 1. Under our analogy, this corresponds to the condition SYS ニル 
which is equivalent to S being a unitary operator. Hence the analogy shows that 
the unit circle in C corresponds to the set of unitary operators. In the next two 
results, this analogy appears in the eisenvalues of unitary operators. Also see 
Exercise 15 for another example of this analogy. 


7.54  e7ge7zvg77zey の 7 7777727y OD67 の 7 の 7 7 の ye の の so/777e rg/74e 1 


Suppose ル is an eigenValue of a unitary operator. Then |A| = 1. 


Proof Suppose 5 と 々 () is a unitary operator and ん is an eigenvalue of 5. Let 
と Vbesuchthato チ 0 and 5o = Ao. Then 


|Al ll = Agl| = 52l = Il. 
Thus |A| = 1, as desired. 


The next result characterizes unitary Operators on finite-dimensional complex 
inner product spaces, using the complex spectral theorem as the main tool. 


7.55 gesc7/ の 77O77 の 7 7727727Y の De7 の 7O7 ゞ O72 CO777 の /r 7777267 の 7 の の 77C7 の の C@y 


SupposeF = Cand 5 ヒモ 々 ( り ). Then the following are equivalent. 
(a) 5 is a unitary operator. 


(b) There is an orthonormal basis of 『 consisting of eisenvectors of 5 whose 
corresponding eigenvalues all have absolute Value 1. 


Proof Suppose (a) holds, so 5 is a unitary operator. The equivalence of (a) and 
(b) in 7.53 shows that S is normal. Thus the complex spectral theorem (7.31) 
shows that there is an orthonormal basis e」, .…,e, Of V consisting of eigenvectors 
of 5. Every eigenvalue of S has absolute value 1 (by 7.54), completing the proof 
that (a) implies (b). 

Now suppose (b) holds. Let e」, .……,e, be an orthonormal basis of 『 consisting 
of eieenvectors of 5 whose corresponding eigenvalues A」, .…, ん ル , all have absolute 
value 1. Then 5e」, …, Se, is also an orthonormal basis of because 


0 下地 ん 

1 下 / ニ た 

for al た = 1,.…,7. Thus the equivalence of (a) and (d) in 7.53 shows that 5 is 
unitary, Droving that (b) implies (3). 


(5e,, Se) 三 (4@:, Azer) 三 4.Ak@.。 ek) 還 | 
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び パ 7c7O77<77 の 7 


In this subsection, we shift our attention from operators to matrices. This switch 
should give you good practice in identifying an operator with a square matrix 
(after picking a basis of the vector space on which the operator is defined). You 
should also become more comfortable with translating concepts and results back 
and forth between the context of operators and the context of square matrices. 

When starting with 7-by-7 matrices instead of operators, unless otherwise 
specified assume that the associated operators live on F" (with the Euclidean inner 
product) and that their matrices are computed with respect to the standard basis 
of F". 

We begin by making the following definition, transferring the notion of a 
unitary Operator tO a unitary matTiX. 


7.56 definitlon: 7777727y 7 の 777 


An ヵ 7-by-7 matrix is called 777y 1 its columns form an orthonormal list 
in F". 


In the definition above, we could have replaced “orthonormal list in F“” with 
“orthonormal basis of F"” because every orthonormal list of length 7 in an 7- 
dimensional inner product space is an orthonormal basis. If S と 々 () and 
6 … っ 6 8nd 訪 ,…, 万 are orthonormal bases of V then 5 is a unitary operator 
if and only if 77(5,(e」,…) 6。),( 訪 ,…> 刻 )) 1S a unitary matrix, as shown by the 
equivalence of (a) and (e) in 7.49. Also note that we could also have replaced 
“columns" in the definition above with “rows” by using the equivalence between 
conditions (a) and (e) in 7.53. 

The next result, whose proof will be left as an exercise for the reader, gives 
some equivalent conditions for a square matrix to be unitary. In (c), Oo denotes 
the matrix product of 0 and o, identifying elements of F" with 7 ヵ -by-1 matrices 
(sometimes called column vectors). The norm in (c) below is the usual Euclidean 
norm on F" that comes from the Euclidean inner product. In (d), 〇 * denotes 
the conjugate transpose of the matrix O, which corresponds to the adjoint of the 
associated operator. 


7.57 Cc/7 の 7677<77O775 O7 7777777 ツ 777777C@y ゞ 


Suppose 0 is an 7-by-7 matrix. Then the following are equivalent. 


(a) Ois a unitary matrixX. 


(b) The rows of 0 form an orthonormal list in F" 


(c) IOel = lgll for every oe FE" 


(① OYQO = QO* = 了 7 the 7-by-7 matrix with 1*s on the diagonal and 0's 
elsewhere. 
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The QR factorization stated and proved below is the main tool in the widely 
used OR algorithm (not discussed here) for finding good approximations to 
eigenvalues and eigenvectors of square matrices. In the result below, せ the matrix 
4 isinF" の then the matrices O and 尺 are also in FT 


7.58 OA 記 c7o77<77O72 


Suppose 4 is a square matrix with Hinearly independent columns. Then there 


extst unique matrices 〇 and A such that 〇 is unitary, R is upper triangular 
with only positive numbers on its diagonal, and 


4= OK. 


Proof Leto」,.…, の , denote the columns of 4, thought of as elements ofF". Apply 
the Gram-Schmidt procedure (6.32) to the Hst の 」, ……, の ,, getting an orthonormal 
basis e, ……,e6, Of F7 such that 


7.59 SDan( の 1, …, の 。) 三 SDan(e, …, @) 
for each た = 1,.…,. Let Kbe the 7-by-77 matrix defined by 


0 ビー (の 7 が 


where K , denotes the entry inroW ヵ column た ofR. 7> た thene.iS orthogonal 


to spPan(@,…。 gw) and hence e, is orthogonal to or (by 7.59). In other words。 
> た then の) 三 0. Thus R is an upper-triangular matrix. 

Let O be the unitary matrix whose columns are e」,…, 6 IT 三 {1,.…,7), 
then the 名 column of OR equals a linear combination of the columns of O, with 
the coeficients for the linear combination coming from the 名 column of 一 see 


3.51(a). Hence the Acolumn of OR eduals 
(の 。。 6176] 填 … 十 (の 676 ん 


which equals co, [by 6.30(a)], the A び column of 4. Thus 4 = OR, as desired. 

The equations defining the Gram-Schmidt procedure (see 6.32) show that 
each ?, eduals a positive multiple of er plus a Hinear combination of e」,…,er_」・ 
Thus each (の er) 1S a positive number. Hence all entries on the diagonal of are 
Positive numbers, as desired. 

Finally, to show that 〇 and Rare unidue, suppose we also have 人 4 = O R, where 
O is unitary and Ris upper triangular with only positive numbers on its diagonal. 
Let g,…, 7 denote the columns of Q. Thinking of matrix multiplication as aboVe, 
we see that each or is a Hinear combination of 9], .…, 9。 With the coeffcients coming 
from the 記 column of R. This implies that span( の ], の) 三 SDan(9,…, 9k) 8nd 
(の 92 > 0. The uniqueness of the orthonormal lists satisfying these conditions 
(see Bxercise 10 in Section 6B) now shows that 7。 ニ efor each た = 1,.…,7. Hence 
O = 0, which then implies that R = Ki completing the proof of uniqueness. 
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The proof of the OR factorization shows that the columns of the unitary matrix 
can be computed by applying the Gram-Schmidt procedure to the columns of the 
matrix to be factored. The next example illustrates the computation of the OR 
factorization based on the proof that we just completed. 


7.60 example: OA 認 c7 の 77z77O77 の 7 6 3-y-3 7 の 7 


To find the OR factorization of the matrix 


1 2 1 
4=| 0 1 -4 
0 3 2 


follow the proof of 7.58. Thus set の, の っ , の 。 edual to the columns of 4: 
(2 ビー (1, 0,0), の っ ーー (2, 1, 3), の 3 王 (1, 一 4,2). 
Apply the Gram-Schmidt procedure to の 」, の >, の 。, DrTOducing the orthonormal list 
ー ー ニ (0 ニー ご ーー ニー 
61 デ (1,0, 0), 6 っ = (0. 10" 63 = (0. y10” の 


Still following the proof of 7.58, let O be the unitary matrix whose columns are 


6], 6 っ, 6 っ : 
1 0 0 

D 手こき 

O = V10 Y10 

人 

y10 。 vV10 


Asin the proof of 7.58, let be the 3-by-3 matrix whose entry in row /, column た 
1S (の , が which gives 


1 2 1 
V10 
A=| 0 vV10 合 
ZV10 
0 0 写 


Note that AR is indeed an upper-triangular matrix with only positive numbers on 
the diagonal, as required by the QR factorization. 

Now matrix multiplication can verify that 4 = ORis the desired factorization 
of 4: 


央 間 必 みゆ 。 1 
1 2 1 
1 3 
oR=| 0 需 - 高 |0 VO 堂 | っ 
0 ま Zv10 0 3 2 
y10 yi6 た 


Thus 4 = OK, as expected. 


The QR factorization will be the major tool used in the proof of the Cholesky 
factorization (7.63) in the next subsection. For another nice application of the QR 
factorization, see the proof of Hadamard's inequality (9.66). 
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Tf a QR factorization is available, then it can be used to solve a corresponding 
system of Hnear equations without using Gaussian elimination. Specifically, 
SuDDOse 4 is an 7-by-7 square matrix with linearly independent columns. Suppose 
that ち と F" and we want to solve the equation 4x ニ pfor ァ ニテ (」,…,) 三 F" 
(as usual。 we are identifying elements of F" with ヵ -by-1 column vectors). 

Suppose 4 = OK, where O is unitary and is upper triangular with only 
positive numbers on its diagonal ( 〇 and R are computable from 4 using just the 
Gram_-Schmidt procedure, as shown in the proof of 7.58). The equation 4 ァ ニ bis 
eduivalent to the equation ORx = ち . Multiplying both sides of this last equation 
by OY on the left and using 7.37(d) gives the equation 


Rx = O* ち . 


The matrix 〇 Y is the conjugate transpose of the matrix O. Thus computing 
OY ヵ is straishtforward. Because R is an upper-triangular matrix with positive 
numbers on its diagonal, the system of linear equations represented by the equation 
above can quickly be solved by frst solving for r,, then for *,_」, and so on. 


C7o/es ん y 7c7O77Z77O77 


We begin this subsection with a characterization of positive invertible operators 
in terms of inner products. 


7.61 pos777ve 72De777//e の De77 の 7 


A self-adjoint operator 7 々 (V) is a positive invertible operator if and only 
下 7?, の ) > 0 for every nonzeroo と WV 


Proof Hirst suppose 7 is a positive invertible operator. ITo と ando 子 0, then 
because 了 is invertible we have 7 ゥ チ 0. This implies that (7?, の ) チ 0 (by 7.43). 
Hence 7?,?) > 0. 

To prove the implication in the other direction, suppose now that 7?,?) > 0 
for every nonzeroo  V Thus 7? チ 0 for every nonzeroo と ば Hence ア 7 is 
injective. Thus 7 了 is invertible, as desired. 


The next defimition transfers the result above to the language of matrices. Here 
we are using the usual Euclidean inner product on F" and identifying elements of 
F" with 7-by-1 column vectors. 


7.62 definition: poy777e de777777e 
Amatrix FE" 7 is called pos7 が ve ee 導 F デ ー ニ pand 


(Br, y) > 0 


for every nonzero *  F* 
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A matrix is upper triangular if and only iits conjugate transpose is lower 
triangular (meaning that all entries above the diagonal are 0). The factorization 
below, which has important consequences in computational hnear algebra, writes 
a Dositive definite matrix as the product of a lower triangular matrix and its 
coOnjugate tTanSDOSC. 

Our next result is solely about matrices, although the proof makes use of the 
identification of results about operators with results about square matrices. In the 
result below, 導 the matrix pis inF の * then the matrix Ais also in F の 


7.63 C7o/es ん y 7c7O77<77O72 


Suppose p is a positive definite matrix. Then there exists a unidue uDDeT- 


triangular matrix with only positive numbers on its diagonal such that 


jp ニ AYA. 


Proof Because ぢ is positive definite, there exists an invertble square matrix ん 
of the same size as p such that p = 4*4 [by the equivalence of (a) and (⑪ in 
7.38]. 

Let4=ORbe the OR factorization of 4 (see 7.58), where O is unitary and 
is upper triangular with only positive numbers on its diagonal. Then 4* ニ RYOT 


Thus 47 の る @-7ozzy Co/es な oy (7825-7978) 
ー 4 玉 4 の ※ の キ _ ゎ \ g7scove7e の 7775 Cc7O7Z<77 の 7 WC 
2 gy /4 の 77572e7 の y777772O745 の 72 7 の 2 プ . 

as desired. 

To prove the uniqueness part of this result, suppose 5 is an upper-triangular 
matrix with only positive numbers on its diagonal andp= SYS. The matrix S is 
invertible because is invertible (see Exercise 11 in Section 3D). Multiplying both 
sides of the equation p = S*S by 5~~ on the left gives the equation BS-! = 5 

Let 4 be the matrix from the first paragraph of this proof. Then 


(45-①)“(49-1) = (9) め -14*45-! 
還 (5*)-1g9-! 
ー (5*)-15* 
= ィ . 


Thus 45~} is unitary. 

Hence 4 = (45~})S is a factorization of 4 as the product of a unitary matrix 
and an upper-triangular matrix with only positive numbers on its diagonal. The 
unidueness of the OR factorization, as stated in 7.58, now imples that 5 = KR. 


In the frst paragraph of the proof above, we could have chosen 4 to be the 
umidue positive defimite matrix that is a square root of p (see 7.39). However, 
the proof was presented with the more general choice of 4 because for specific 
positive definite matrices ぢ , it may be easier to find a different choice of 4. 


26S 
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re7cz7yey / 


10 


11 


12 


Suppose dim ソ >2and5 と 々 (W). Prove that S is an isometry if and 
only if Se」, 5e。 is an orthonormal list in W for every orthonormal Hst e」,e。 
of length two in 


Suppose 7 と (Y, W). Prove that 7 is a scalar multiple of an isometry if 
and only エ 了 preserves orthogonality. 


77e /77gye “ 了 /7ese7V@ ゞ O7777Ogo7 の 7 の "72eg72y 77g7 (7 7 の ) = 0 77 7/ 
7 の Vszc7 27 (の) 三 0. 


(a) Show that the product of two unitary operators on V is a unitary operator. 
(b) Show that the inverse of a unitary operator on is a unitary operator. 


777s ere7c7se 7Oy 7 77e se7 の / 7777777Y O の 677O7S 77 V 7S の 87 の 7 の , Ve7e 
7e 67 の の の /67 の 77 の 7 75 7e 74547 7 の 4C7 の 7 7 の の の 6777 の 75. 


SupposeF = Cand 4.B と 々 ( ツ ) are self-adjoint. Show that 4+ 万 s 
unitary 導 and only 症 4B = p4and4+ 2 ニア 


Suppose 5 々 (). Prove that the following are equivalent. 

(&) 5 is a self-adjoint unitary operator. 

(b) 5 =2Pー 了 for some orthogonal projection Pon 

(c) There exists a subspace of Vsuch that 5 =zforeveryz ロ and 
Sp ニー の for every の ゅ モエ 


Suppose 本 , 7> are both normal operators on F? with 2,5,7 as eigenvalues. 
Prove that there exists a unitary operator 5 と の (E?) such that 了 ア 7 = 5*755. 


Give an example of two self-adjoint operators 7,7> と 々 (E*) such that the 
eigenvalues of both operators are 2,5, 7 but there does not exist a unitary 
operator 5  (E*) such that 7」 = 5*7。5. Be sure to explain why there is 
no unitary operator with the required property. 


Prove or give acounterexample: f 5 と 々 () andthere exists an orthonormal 
basis e」,…,6, Of such that ISeul| = 1 for each e, then 5 is a unitary Operator. 


SupposeF = Cand 了 と る (). Suppose every eigenvalue of 7 has absolute 
value 1 and IT?l < lgl for every vV Prove that ア is a unitary operator. 


SupposeF =Cand ア 7 と ( ゆ ) is a self-adjoint operator such that ITol| < |gl 
for allo と 
(a) Show that7ー7 テ is apositive operator. 
(b) Show that 了 + fj ソナー ザ 2 is a unitary operator. 
Suppose 5 々 (). Prove that 5 is a unitary operator if and only ザ 
{5o :o と and gl <11 = (oEY: lg <1). 


Prove or give a counterexample: TS と ( じ ) isinvertible and |5-+o| = Sol 
for everyo と V\ ば then 5 is unitary. 
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13 


14 


15 


16 


17 
18 


19 


20 


Explain why the columns of a square matrix of complex numbers form 
an orthonormal list in C" and only ぜ the rows of the matrix form an 
orthonormal Hist in で". 


Supposeo with ll = 1 and ち 6 F. Also suppose dim リ > 2. Prove 
that there exists a unitary operator 5 々 (V) such that (5o, の ) = if and 
onlyif 切 <1. 


Suppose is a unitary operator on such that 7ー リ 7is invertible. 


(a) Prove that 7+ カ (7ー カ カー「 is a skew operator (meaning that it equals 
the negative of its adjoint). 
(b) Prove that ifF = C,then77+ ーー isa self-adjoint operator. 


77e 放 7c7 が op Z 7(Z+1)(Zー1)-! 娘 Zps 如 e 277 c7c/e 7 で (excep7 67 77e 
po777 1) 7o R. 77745 (の ) 妨 47747ey 娘 e の 727 の gy の e7vee7 77e 77727797 ツ の の 67 の 7 の 7? 
g79 77e 7277 C77C/e 7 で, 7o7g 7777 77e 7 の gy の envee7 777e ye/ た 4 の O7777 
O/@7 の 7 の 7y 74 の R. 


SupposeF = Cand 李 と 々 (D) is self-adjoint. Prove that 7+ の 7ー 77)ー ハ 
is a unitary operator and 1 is not an eigenvalue of this operator. 


Explain why the characterization of unitary matrices given by 7.57 holds. 


A square matrix 4 is called sy7ze777c t せ it equals its transpose. Prove that if 
4 is a symmetric matrix with real entries, then there exists a unitary matrix 
O with real entries such that O*40 is a diagonal matrix. 


Suppose 7 1S a Dositive integer. For this exercise, we adopt the notation that 
a typical element z of C" is denoted by z = (20,2Z],…,2ー ュ ). Define Hinear 
functionals の , の … の 1 On C" by 


1 7z-1 


ー277 ガ 77/7 
> ニョ ルー ーー 6 5 
V7 ん 


The gsc7e7e oz77e7 7g757O7772 1S the operator プ CC っ で 7 defmed by 


の (20, 2 … 


プ ァ ニニ (の o(②), の 1(2),…, の 1 ュ (Z) ) 
(a) Show that デ is a unitary operator on C“ 
(b) Show that if (20,…, 2 ィ ) と で " and z, is defined to equal zo, then 
02 一 


(c) Show that ダキ ニア 


77e 7sc7e7e O747767 7 の 727 の 7777 7 の 9 77272Y 777 の の 77d777 の の 77C の 77O725 7 の 7 の 

g797yy75. 77e 454/ 7 の 7767 7 の 7297 の 7777 77VO/ ル eS 6X/7 ら yy7O7S O/ 77e /2777 
9 ー277 が Y り 

が 。 げ ()e gr 27 co7 の ex-vg7zzeg 777eg7 の の /e 77c77O75 / の e777eg o77 R. 


Suppose 4 is a square matrix with linearly independent columns. Prove that 
there exist unique matrices AR and O such that R is lower triangular with only 
positive numbers on its diagonal, O is unitary。 and 4 = AO. 
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// 577g777 77e の eco77 の の 5777O7 


S772677727 V7/7ey 


We will need the following result in this section. 


7.64 p7ope777ey の 7 7 デア 


Suppose 7 々 (V W). Then 
(2 7 デア is apositive operator on P: 


(b) null 7 パ ア 7 ー null 7: 


(c) range 7* ア ーrange 7 テ : 


(④ dimrange7 = dimrange7* = dmrange 7 パイ 


Proof 
(a) We have 
(7*7)” = 7“F(7*)) = 7* ア | 
Thus 7 ザイ is self-adjoint. 
Ifo と then 
(7*7)o.o) = (7T*7 の ,o) = To.7o) = ToI7 0. 
Thus 7 ポア is a positive operator. 


(b 


ヽ ュ ン 


First supposeo null7*7. Then 
| 上院 串 = (eV っ (Ye) ニ (0 の ニテ 0 
Thus 7? = 0, proving that nul17 パ 7 で null7 


The inclusion in the other direction is clear, because fo と and7o =0, 
then 7*7To=0. 


Thus null 7*7 = null 子 , completing the proof of (b). 
(c) We already know from (a) (hat 7 パ ア is self-adjoint. Thus 
range 7 アー (nul 0 = (null7)~ =range 7 も 
where the frst and last equalities come from 7.6 and the second equality 
comes from (b). 
(d 


ュ ン 


1o verify the first equation in (⑨, note that 
dimrange7 = dim(null7*)~ = dim W 一 dimnull7* = dimrange 7 を 


where the frst equality comes from 7.6(d), the second equality comes from 
6.51, and the last equality comes from the fundamental theorem of Hinear 
maps (3.21). 


The equality dimrange7* = dimrange 7 パ 7 follows from (c). 
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The eigenvalues of an operator tell us something about the behavior of the 
operator. Another collection of numbers, called the singular values, is also useful. 
Eieenspaces and the notation (used in the examples) were defined in 3.52. 


7.65 definitlon: sgz/g7 vg7es 


Suppose 了 ビズ (W). The gz/27 vg/ey of 李 are the nonnegatiVe sduare 
roots of the eigenvalues of 7* 了 , listed in decreasing order each included as 
many times as the dimension of the corresponding eigenspace of 7* ア . 


7.66 example: が 77 V7ey の 7 の 2 の Pe7g7 の 7 o77 F* 


Defne 7 ー (FE?) by 了 (z], 2 っ, 23,24) 三 (0,3z」,2z。, 一 3z。). A calculation 
shows that 


7 イイ (ZZ, 25, 4 ) 三 (9z」, 42。, 0, 9z。), 


as you should verify. Thus the standard basis of F* diasgonalizes 7* 了 ア , and we 
see that the eigenvalues of 7*7 are 9, 4, and 0. Also, the dimensions of the 
eigensDaceSs COTTesponding to the eigenvalues are 


dmE(9.7 パ 7) =2 and dimE(4.777 の =1 and dimE(0.7 ア 7) = 1. 


Taking nonnegative square roots of these eigenvalues of 7*7 and using dimension 
information from above, we conclude that the singular values of ア are 3,3, 2,0. 

The only eigenvalues of 7 are 一 3 and 0. Thus in this case, the collection of 
eigenvalues did not pick up the number 2 that appears in the definition (and hence 
the behavior) of 了 , but the Hist of singular values does include 2. 


7.67 example: szg7/7 vg7es O7 6 7/7e7 7 の 77o77 FT 7o FE? 


Suppose 7 々 (F*、E?) has matrix (with respect to the standard bases) 


0 0 0 -5 
0 0 0 0 |. 
1 1 0 0 


You can verify that the matrix of 7*7 is 


つら ロー 
つつ 選 ーー 
G: で で 
(ep < の (<) 


0 0 0 25 


and that the eigenvalues of the operator 7“7 are 25, 2, 0, with dim E(25,7* ア 7) = 1. 
dmE(2.7* ア 7) = 1, and dim E(0.7“ ア 7) = 2. Thus the singular values of ア are 


5, V2, 0,0. 


See Exercise 2 for a characterization of the positive singular values. 
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7.68 7o/e の 7 の y777Le s772877777 V/77ey 


Suppose that 7 と 々 (WW). Then 


(a) 7 is injective < 三 0iSnot asingular value of 7 


(b) the number of positive singular values of 7 equals dim range 了 : 


(c) 1is surjective e つ number of positive singular values of equals dim IMW. 


Proof The Hinear map 7 is injective せ and only Tnul アテ (0}), which happens 
if and only if null7 ザ アテ (0) [by 7.64(b)], which happens if and only i0isnot 
an eisenvalue of 7*7, which happens if and only if 0 is not a singular value of 子 , 
completing the proof of (a). 

The spectral theorem applied to 7 パ ア shows that dim range7* イ equals the num- 
ber of positive eigenvalues of 7“7 (counting repetitions). Thus 7.64(c) implies 
that dimrange7 equals the number of positive singular values of 子 , proving (b). 

Use (b) and 2.39 to show that (c) holds. 


The table below compares eigenvalues with singular values. 


Hist of eigenvalues jist of singular values 


context: VeCtOT SDaCeSs context: inner Droduct sDaces 


defined only for linear maps from a vector | defined for linear maps from an inner 
Space to itself product space to a possibly different inner 
product space 


can be arbitrary real numbers (ifF = R) | are nonnegative numbers 
or complex numbers (iTF =) 


can be the empty listif ギ =R length of list equals dimension of domain 


includes 0 < っ operator is not invertible | includes 0 e つ Hinear map is not injective 


no standard order, especially fF=C always listed in decreasing order 


The next result nicely characterizes isometries in terms of singular values. 


7.69 7 が 5o7e777ey C7727C7e77<6 の の 7 の V772g 97/ s777g7727 Y774ey eg74/ 1 


Suppose that 5 と 々 (WW). Then 


S is an isometry < っ allsingular values of S equal 1. 


Proof Wehave 
S is an isometry < っ SYS ニ = ニ 了 7 
* っ all eigenvalues of 5*S equal 1 


* allsingular values of S equal 1, 


where the frst equivalence comes from 7.49 and the second equivalence comes 
from the spectral theorem (7.29 or 7.31) applied to the self-adjoint operator 5*S. 
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SV の 7 77eg7 7 の 5 7 / の 7 /74777Cey 


The next result shows that every hmear ZZ。 計 謗 22022202287080 ゆ 
map from V to W has a remarkably clean 4y@/74/ 77 CO77 の 777977O72/ 7/77767 の /ge- 
description in terms of its singular Val- 4 pecgse goog 7ec/777 の ey eZS7 7 
ues and orthonormal lists in and W. pyox77g7g ege7vg//es 7 e7ge7- 
In the next section we will see several rec/ors の 7 pos7ve Ope7G7O7y SC g5 
important applications of the singular 7 テア ose ege7V7ey の 2 e7ge7VeC- 
Value decomposition (often called the 7ors 7egd 7o 77e s7zgz47G7 V/ze eco77- 
SVD). Os777O7. 


7.70 5772g74727 vg/77e の eco777 の OS777O72 


Suppose 7 三 々 (VMW) and the positive singular values of 7 are 5s」,…,5,,. 
Then there exist orthonormal Hsts e」,…, em and 方 , …, 刻 , in W such that 


聞 略 | Mi 三 51( の , @]) 刻 icesoso 5 の の 


for everyo と WV 


Proof Let s」,.…,s, denote the singular values of 了 (thus 7 = dim り ). Because 
7 テア is a positive operator [see 7.64(a)], the spectral theorem implies that there 
exists an orthonormal basis e」, .…,6, Of V with 
7 = 


for each = 1,.……,7. 
For each ん = 1,.……,77。 let 


7.73 衣 = ニ ーー. 


ff, た 人, …, 77), then 
0 7/ チ ん 


1 1 Sr 
ME っ 二 の の ぜ / ニ た 


が k / 
Thus 訪 , …, 刻 , 1S an orthonormal list in W. 
Te 人 1,…,7) and た > then s, = 0andhence 7*7e, = 0 (by 7.72), which 
implies that 7e, = 0 [by 7.64(b) ]. 
SupposeoV Then 


ナ の 二 了 (( の en )e1 二 39e 中 (の の 5) 
三 (の ⑦,e1)7e6」 キー (の 276 
王 51( の , 1) 方 キ yw 二 66 


where the last index in the first line switched from 7 to 77 in the second jine 
because 7e. = 0 ザ た > 7 (as noted in the paragraph above) and the third line 
follows from 7.73. The equation above is our desired result. 
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Suppose 7 々 (\ ゆ W), the positive singular Values of are s],.……,5。, and 
っ 6 and 訪 ,…) 万, are as in the singular value decomposition 7.70. The 
orthonormal list e, .…,e, Can be extended to an orthonormal basis e],… せ env 
of and the orthonormal Hist 刻 , …, 万 , can be extended to an orthonormal basis 


方, … mw Of W. The formula 7.71 shows that 


if1 < ん た <77, 
0 if 娘 こん < く dim 


Thus the matrix of with respect to the orthonormal bases (er,.…, egmy) and 
(,…) 訪 mw) has the simple form 


9k 


if1< く 7 ニル た < 
2 (em の の mw 3 
If dim = dim W (as happens, for example, if W = の ), then the matrix 
described in the paragraph above is a diagonal matrix. If we extend the defmition 
of diagonal matrix as follows to apply to matrices that are not necessarily sduaTe, 
then we have proved the wonderful result that every hnear map from to W has 
a diagonal matrix with respect to appropriate orthonormal bases. 


7.74 definition: の go72/ 77777 


An AM-by-/ matrix 4 is called a 2go7g7 7 all entries of the matrix 
are 0 except possibly 4 for た = 1, .…,min(A,A}. 


The table below compares the spectral theorem (7.29 and 7.31) with the 
singular value decomposition (7.70). 


SDectral theorem 


singular value decomposition 


describes only self-adjoint operators 
(when = R) or normal operators (when 
F = の) 


describes arbitrary linear maps from an 
inner product space to a possibly different 
inner product space 


produces a single orthonormal basis 


produces two orthonormal lists, one for 
domain space and one for range space, 
that are not necessarily the same even 
when range sDace eduals domain space 


different proofs depending on whether 
F=RorF= ニ C 


same proof works regardless of whether 
F=RorFーC 


The singular value decomposition gives us a new way to understand the adjoint 
and the inverse of a hnear map. Specifically, the next result shows that given a 
singular value decomposition of a linear map 了 と 々 ( W), we can obtain the 
adjoint of ア simply by interchanging the roles ofthe es and the が s (see 7.77). 
Similarly, we can obtain the pseudoinverse 7T (see 6.68) of ア by interchanging 
the roles of the es and the が s and replacing each positive singular value s, of 子 
with 1/s, (see 7.78). 
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Recall that the pseudoinverse 7T in7.78 below equals the inverse 7ー「 if 了 ア is 
invertible [see 6.69(a)]. 


7.75 5772g74727 vg777e の eco777 の OS777O77 O/ 7O7777 972 ye77 の O777U6756 


Suppose 7 生々 (VMW) and the positive singular values of 了 are s」,.…,5。. 
SuDDOSe e],…, 6 3nd 訪 , …, 万 , are orthonormal ists in and W such that 


7.76 OS3(O8CIHNide2 (の 6 
for everyo と V Then 
77 7*o = s1( の 方) キー 5 の 訪 )6 


and 


7.78 7TT 


室 0 土 … 十 @, 訪 7 
51 5 


777 


for every の W. 


Proof Ho と VandwE MW then 


(7o, の) ニ (51( の 1) 廊 キー 5 の 6) 訪 , の ) 


81( の , 6]7( 訪 の ) キー 5 の 627( 訪 , の) 


(の , 51( の , 方 1 中 te 中 (026) 


This implies that 
7 了 ネ の 三 51( の , 方 ) "ssss: 路 5。( の , た の 6 


proving 7.77. 
To prove 7.78, suppose の W. Let 


の 三 1 の 上 便 二 … 十 人 な) 。 
91 9 
Apply 7 to both sides of the equation above, getting 
の , の , 77 
ーー 2P 1 の た 
91 9 坊 


一 (@, 方 ) 方 まま ィ y 中 (の ん) ん 


了 の 


777 


Tange ア の ,。 


where the second Hine holds because 7.76 implies that 7e, = sr 太 下 た = 1,…,77, 
and the last line above holds because 7.76 implies that 方 , …, 刻 , SDans range7 and 
thus is an orthonormal basis of ranse7 [and hence 6.57G① applies]. The equation 
above, the observation that o と (null ア )~ [see Exercise 8(b)], and the definition 
of Tp (see 6.68) show that o = 7T「zp、 proving 7.78. 
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7.79 example: 万 77g 577674777 7776 の ecCO777 の 5777 の 7 


Define 7 と 々 (ET,EP) by 7(Y」, 3, 4) = (一 5x4, 0,*」 + *。). We want to 
find a singular value decomposition of 了 7. The matrix of ア (with respect to the 


standard bases) is 
0 0 0 -5 
0 0 0 0O ] 
1 1 0 0 


Thus, as discussed in Example 7.67, the matrix of ポア is 


0 0 
0 0 
0 0 [| 
0 25 
and the positive eigenvalues of 7*7 are 25, 2, with dim E(25,7* ア ) = 1 and 
dim FE(2.7*7) = 1. Hence the positive singular values of 7 are 5. V2. 

Thus to fimd a singular value decomposition of 了 ア , we must find an orthonormal 
list e」,e。 in F* and an orthonormal list 方 , in F" such that 


了 の ニー 5(?, 2 ) 方 直 V2( の @) 


for allo FE*. 

An orthonormal basis of (25,7 ザ 7) is the Vector (0,0,0,1): an orthonormal 
basis of (2.7 デ ア ) is the Vector ( っ * な 0, 0). Thus, following the proof of 7.70, 
We take 二 3 

e」 三 (0.0.0.1) and e。= (っ ニ ー0.0) 
NM2 Ve 
and 


了 e」 ナ @ 
方 三 三 (-1,.0.0) and 記 三 時 = (0,0,1). 


Then, as expected, we see that e」,e。 is an orthonormal list in F* and 訪 , is an 
orthonormal list in F? and 


了 の ニー 5(?, 1 ) 方 直 V2@, の ) 


foralloE*. Thus we have found a singular value decomposition of 好 


The next result translates the singular value decomposition from the context 
of inear maps to the context of matrices. Specifically, the following result gives 
a factorization of an arbitrary matrix as the product of three nice matrices. The 
proof gives an explicit construction of these three matrices in terms of the singular 
Value decomposition. 

In the next result, the phrase “orthogonal columns"” should be interpreted to 
mean that the columns are orthogonal with respect to the standard Euclidean inner 
product. 
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7.80 7 が ve757o77 の 7 SV の 


Suppose 4 is an AM-by-7 matrix of rank 77 > 1. Then there exist an ん -by-77 
matrix with orthonormal columns, an 7 が -by-7z diagonal matrix り with 


positive numbers on the diagonal, and an 77-by-77 matrix C with orthonormal 
columns such that 


し 他 0 け ) の (@ 


Proof Let 了 : F” っ FY be the linear map whose matrix with respect to the 
standard bases equals 4. Then dimrange ア 7 = 7 (by 3.78). Let 


7.81 7? =g1( の em) 廊 オ ー ナ 5 が の 6) 訪 
be a singular value decomposition of 了 7. Let 


jp = the AM-by-7z matrix whose columns are 方 ,…。 ん 
り = the 7-by-7z dagonal matrix whose diagonal entries are 5],……, 5 


C = the 7-by-77 matrix whose columns are 6],…。 6 
Let 7 ,…, 7 denote the standard basis ofF". If た 人 1, .…, 7) then 
(4C 本 p り ) ヒー 4er デ ぢ (sr) ヒー sz ん = sz ヒー 0. 


Thus 4C = p り . 
Multiply both sides of this last equation by C* (the conjugate transpose Of C) 
on the right to get 
4CC* = DC 


Note that the rows of C* are the complex conjugates of e」,…,e. Thus i 
r 人 1, .…, 嫌 }, then the definition of matrix multiplication shows that C*e, = 
hence CC*er = er. Thus 4CCYo = 4oforallo span(e],…, 6,)・ 

TFo (span(e」,….g)) ~, then 4o = 0 (as follows from 7.81) and C*o = 0 
(as follows from the definition of matrix multiplication). Hence 4CCYo = 4o for 
allo (span(ei, 0 

Because 4CC* and 4 agree on span(e」,…,6。) and on (span(e」,…,6)) We 
conclude that 4CC* = 4. Thus the displayed equation above becomes 


4 = DCY, 


as desired. 


Note that the matrix 4 in the result above has ん 7 entries. In comparison, the 
matrices , り , and C above have a total of 


77(AMf 二 女 二 77) 


entries. Thus if and 7 are large numbers and the rank 77 is considerably less 
than AM and ヵ , then the number of entries that must be stored on a computer to 
represent 4 is considerably less than 7 ヵ . 
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re7c7yey // 


Suppose 了 と ズバ (W). Show that 了 アテ 0 下 and only fall singular values of 
了 are 0. 


Suppose 了 と ズ (W) and s > 0. Prove that s is a singular value of ア 7 and 
only there exist nonzero vectors の ando MW such that 


7o= ニ so and 7 パーso. 


77,e uec7O7 ゞ の , の sd757 か 7 が 46 の の 7 697477O74 ゞ の の ove g76 Cg7/c 7 Sc747277 77. 
万 77077 Sc77777 77777 の gce 77e co72ce/7 の / 577264747 rg7zey 7 7907/. 


Give an example of 7 々 (C^) such that 0 is the only eigenvalue of 7 and 
the singular values of 了 are 5,0. 


Suppose that 了 と ズバ ( し WW), s」 is the largest singular value of 了 , and s, is 
the smallest singular value of 了 . Prove that 


{I7gl : の と and Hg = 1) = [5,,5:]. 


Suppose 7 々 (C") is defined by 7(r,y) = (一 4y,*). Find the singular 
Values of 李 


Find the singular values of the differentiation operator り と 々 (の (R)) 
defined by り ヵ = 万 where the inner product on グ の 5(R) is as in Example 6.34. 


Suppose that ア と 々 (げじ ) is self-adjoint or thatF =Cand 李 と ん () is 
normal. Let 人 .…, ん, be the eigenvalues of 了 , each included in this jst 
as many tmes as the dimension of the corresponding eigenspace. Show 
that the singular values of 了 are |A | .…,| ル | after these numbers have been 
sorted into decreasing order. 


Suppose7 と ズバ ((W). Suppose s、 有 ss テー テン 5, > 0 and e],…) 6 15 an 
orthonormal list in and 訪 ,… 万 1S an orthonormal Hist in W such that 


7? = s1( の ,61) 放 キー イエ 5 の 6) 訪 


for everyo と と 


(&) Prove that 方 ,… 刻 , 1S an orthonormal basis of range 7 了 . 

(b) Prove that g」,…, is an orthonormal basis of (null77)~. 

(c) Prove that s」, .…, sare the positive singular values of 李 

⑨① Prove that if 1, .…, 加 ), then e, is an eigenvector of 7*7 with corre- 
sponding eigenvalue s た 

(e) Prove that 


77 ド zo ニ sT( の 。 方 ) 方 本 2ce 調 5z(G の 。 7 


for al W. 


10 


11 


12 


13 


14 


15 


16 


17 
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Suppose 7 EZ W). Show that 7 and 7* have the same positive singular 
values. 


Suppose 7 と (WW) has singular values s」,…,5』. Prove that fiS an 
invertible linear map, then 7ー} has singular values 


1 1 

1 sn 

Suppose that 了 7 と ズバ W) and の 」,.… の, 1S an orthonormal basis of V Let 
S, …。5。 denote the singular values of 

(a) Prove that I7oiIn 和 +…ー+ To 5 イキ … ナ 5 

(b) Provethatif W = ニ リ and ア is apositive operator, then 


(72, の 1) キー エサ の の ) 三 5」 二 … 5 
See 77e Co77772677 の 7e7 Ye7C7Se う 777 Sec7 の 7 /4. 


(&) Give an example of a fmite-dimensional vector space and an operator 了 
on it such that the singular values of 了 2 do not equal the squares of the 
singular values of 

(b) Suppose 7 々 () is normal. Prove that the singular values of 7< 
edual the squares of the singular values of 


Suppose 了 7,7> (の ). Prove that 7 and 75 have the same singular 
Values if and on1y if there exist unitary operators 5」,5。 々 () such that 
了 ュ ヒー 5.755。. 


Suppose 7 と 々 (V W). Let s, denote the smallest singular value of 了 . Prove 
that slgl < 7 for everyo と 


Suppose 7 と 々 (V) and s、> … > s, are the singular values of 了 . Prove 
that ん is an eigenvalue of 李 , then s」 > |A| > 5,. 


Suppose7 と (WW). Prove that 本 = ご) 
Co7 の 7 7e 7e57477 7 7775 ere7C7Se 7 の 777e 727OgO745 76y7777 /27 77De777 め /e 


eg7 7 の PS [see 7.5(| 


Suppose 7 と ズ ( ゆ の). Prove that 7 is self-adjoint 半 and only 7T is self- 
adjoint. 


Matrices unfold 
Singular values gleam Iike stars 
Order in chaos shines 


一 written by ChatGPT with input 2 の の oz7 SV の 
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/7 Co7yeg977677C@y O/ 5772g777 277/e の eco77O5777O77 


Wo7777y の 7 7776g7 7 の y 


The singular value decomposition leads to the following upper bound for ITol. 


7.82 7 の pe7 の oz72 67 7 


Suppose 了 と ズ (W). Let s」 be the largest singular value of 7. Then 


I7ol < sllgl 


for all? と 


Proof Let s」, .…,5。 denote the positive 
singular Values of 了 , and let e」,…, 6 be 
an orthonormal list in and 訪 ,…, ん , be 
an orthonormal list in W that provide a singular value decomposition of 7 Thus 


7o7 og /owe7 /oz7 の o7 7 の /oo ん g7 
尋 re7c7ye 7 イプ 77 Sec77O77 / 万 . 


7.83 7o = の オー 5 の の) 刻 
for allo と V Henceifo と then 
ITeIP =som ド キー+sKog 

回 sf([o, em) ド +…+ [の ey ) 

<s lg 
where the last inequality follows from Bessel's inequahty (6.26). Taking square 
roots of both sides of the inequality above shows that |I7?l| < sllgl, as desired. 

Suppose 7 と (WW) and s」 is the largest singular value of 了 . The result 

above shows that 


7.84 Igll < s」 for allo と with gl < 1. 


Taking? = ei in 7.83 shows that 7e」 = s」 方 . Because | 刻 | = 1, this implies that 
el = s」. Thus because lel| = 1, the inequality in 7.84 leads to the equation 


7.85 max{I7oll : の と and lgll < 1) = 5s.. 


The equation above is the motivation for the following definition, which defines 
the norm of 了 to be the left side of the equation above without needing to refer to 
singular values or the singular value decomposition. 


7.86 definition: 7o777 の 7 eg7 7 の, | 


Suppose 7 々 (V W). Then the zo77z of 子 , denoted by IT is defined by 


IT = maxfI7ol : っ 6 と and gl < 1). 
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In general, the maximum of an infinite set of nonnegative numbers need 
not exist. However, the discussion before 7.86 shows that the maximum in the 
definition of the norm of a Hinear map 了 from to W does indeed exist (and equals 
the largest singular value of 7). 

We now have two different uses of the word 7o777z and the notation | |. Our 
frst use of this notation was in connection with an inner product on when we 
defined llgl| = Yo, の ) for eacho と V Our second use of the norm notation and 
terminology is with the definition we just made of 7 for 了 と (WW). The 
norm 7 for 了 と バア (W) does not usually come from taking an inner product 
of 了 with itself (see Exercise 21). You should be able to tell from the context and 
from the symbols used which meaning of the norm is intended. 

The properties of the norm on (V W) Histed below lookidentical to properties 
of the norm on an inner product space (see 6.9 and 6.17). The inequality in (d) is 
called the 777477g7e 77e9477 か の thus using the same terminology that we used for 
the norm on For the reverse triangle inequality, see Exercise 1. 


7.87 497c /7O/67776 ゞ の 7 7 の 77725 O7 777767 7779 の 9 


Suppose 了 と イズ (W). Then 
(@) I7ll 0: 


(Db) II=0 選 子 ミ 0: 
(c) AI = AII7Ifor allAeE: 
(《⑨ IS+ 7 <I5l+I7Ifor alH5E 々 (WW). 


Proof 
(a) Because I7ol > 0 for everyo と (the definition of 7 implies that 上 7 > 0. 
(b) Suppose ITI = 0.Thus7o=0forallo と withlgl <1.Tfz と with 


7 子 0, then 7 
7u = | 7( 古 ) =0, 


where the last equality holds because z/|| has norm 1. Because 7z = 0 for 
allz と wehave7 ア = ェ 0. 


Conversely, エ 7 了 = テ 0then 7o=0forallo と Vandhence 7 = 0. 
(c) Suppose 4 F. Then 
IA7I = max 才 ATol io と and gl <1) 
= |Almaxfl7ol : の と and lg < 1) 
= AI IT 


(d 


ュ ン 


Suppose S 々 (V W). The definition of IS + 7 implies that there exists 
Vsuch that llgl < 1 and IS+ 本 |6+7 引 . Now 


IS5+ 相 =N6+7 引 | = Se+ Tel < ISgl + Tol SI + IT 
completing the proof of (d). 
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For 5.7 と (WW), the quantity IS 一 可 ~ is often called the distance between 
S and 了 . Informally, think of the condition that IS 一 | is a small number as 
meaning that S and 了 are close together. For example, Exercise 9 asserts that for 
every 了 と 々 ( ゆ ), there is an invertible operator as close to 了 as we wish. 


7.88 g/7e77277re /27777777Z5 /27 7 


Suppose 了 と ズ (W). Then 


(a) IT = the largest singular value of 子 : 
(b) II7I = maxf 作 Tl : の と and | = 1): 


(c) II = the smallest number c such that 7 < cllgll for allo と 


Proof 

(a) See 7.83. 

(b) Lete と be such that 0 < gl < 1. Let z = ィ /|gll. Then 
誕 I7gl 

I| IE 


Thus when finding the maximum of I7ol with Il < 1, we can restrict 
attention to vectors in with norm 1, proving (b). 


= 間 | and 有史 = k( > 7el. 
剛 


(c) Supposeo と ando 也 0. Then the definition of IT implies that 
msm 
lgl 


which implies that 


7.89 I7ol < I7IIel. 


Now supposec > 0 and 7oll < cllgll for allo と V This implies that 
I7gl Sc 


forallo と Vwith lg < 1. Taking the maximum of the left side of the 
inequality above over allo と with lgl < 1 shows that II < c. Thus 上 7 is 
the smallest number c such that Io < cllgll for allo と 攻 


When working with norms of Hinear maps, you will probably frequently use 
the inequality 7.89. 

For computing an approximation of the norm of a hnear map 7 given the 
matrix of with respect to some orthonormal bases, 7.88(a) is ikely to be most 
useful. The matrix of 7* ア is quickly computable from matrix multiplication. 
Then a computer can be asked to find an approximation for the largest eisenvalue 
of 7* ザ ア (excellent numeric algorithms exist for this purpose). Then taking the 
square root and using 7.88(a) gives an approximation for the norm of (which 
usually cannot be computed exactly). 
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You should verify all assertions in the example below. 


7.90 example: 7 の 7777? 


e If7denotes the usual identity operator on then 上 | = 1. 


e IT7 と の (FE) and the matrix of7 with respect to the standard basis of F" 
consists of all 1's, then 上 7 = 7. 


7 と ん ( ゆ ) and り has an orthonormal basis consisting of eigenvectors of 
7 了 with corresponding eigenvalues A」, .… 人 ん,, then 7 1S the maximum of the 
numbers | | …| ル | 


Suppose 7 と (R?) is the operator whose matrix (With respect to the stan- 
dard basis) is the 5-by-5 matrix whose entry in row /, column た is 1/ (/ + ん ). 
Standard mathematical software shows that the largest singular value of ア is 
approximately 0.8 and the smallest singular value of 7 is approximately 10~?. 
Thus I7I 々 0.8 and (using Exercise 10 in Section 7B) 7 10. It is not 
possible to find exact formulas for these norms. 


A jinear map and its adjoint have the same norm, as shown by the next result. 


7.91 7o7777 の 7 如 e 7O777 


Suppose 7 と 々 (WW). Then 7 = II 


Proof Suppose の W. Then 
IT*gl" = (7*e,7*o) = (TTY の ) < TTY lol < ITI IT*Yellll| 

The inequality above implies that 
IPYwl < TI 


which along with 7.88(c) implies that 7 < 7 
Replacing ア with 7* in the inequality 7 < 7 and then using the equation 
(7*) = ア shows that TI < 7 Thus 上 7 = ITIL as desired. 


You may want to construct an alternative proof of the result above using 
Exercise 9 in Section 7E, which asserts that a Hinear map and its adjoint have the 
Same DOSitiVe singular values. 


人 App7or7777777O72 の 77e7 ル 72 の 5 777 oe た の 77677y7O7/ が 7766 


The next result is a spectacular application of the singular value decomposition. 
It says that to best approximate a hinear map by a linear map whose range has 
dimension at most た , chop off the singular value decomposition after the frst 
た terms. Specifically, the linear map 7, in the next result has the property that 
dimrange 陸 = た and minimizes the distance to 了 among all linear maps with 
range of dimension at most た . This result leads to algorithms for compressing 
huse matrices while preserving their most important information. 
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7.92 の es7 の 7OX777677O72 の y 7777e7- 74 の OSe 7 の 7286 5 の 777767297O77 く た 


Suppose 7 々 (V W) and s。 > … ッ > s,, are the positive singular values of ア 
Suppose 1 くん た <77. Then 


min(I7ーSl:S モ Z(W) and dimrange 5 < 応 = skm 


Furthermore, if 
f@ 邦 51( の , @) 族 Hm ooo ar の 2 


is a singular value decomposition of 了 7and 陸 る ( W) is defined by 
7 の ー s1( の 9,e1) 族 エ … 5 の @) 太 


for eacho と then dimrange7, =kand 7 一陽 sk」」. 


Proof Ho と Vthen 
I7 本 7 pp sk」1(@, kr+17 た + ュ 呈 saSar 5 ヵ ( の に | 
= sr の gr1 ド +ー ナ 5 og 


2 2 
< ski(Ko ea ドキ ー ォ ド の g) 
に 本 lgl^ 


Thus 7 ー 又 S 5 The eqguation ゲー)6」」 ニモ skr1 太 」1 nOW shows that 
アー 時 ュ ュ ・ 

Suppose S EZ(\W) and dimranseS < た . Thus 5e」,…, Se which is a 
Hist of length た + 1, is hnearly dependent. Hence there exist g], …,g.」」  F, not 
all 0, such that 

56」 キ … 寺 4156+ ュ ニ 0. 
Now 216」 キ … 二 要 16k+ ュ 1 チ 0 because 2], …, み ょ 1 Te not all 0. We have 


2 の 
I ゲ ザー5(g 本 オー オキ gr1eer1 = 7( 本 本 オー gg) 
当 2 
= lrm 廊 キー 5k+1k+ ュ 衣 + 串 
2」。 12 2 2 
5 Ia ドキ ー イ 58k+ イ 41 
2 12 2 
= skrr(Ia ド キー キ 2 語 近 ) 
ご 2 2 
= sk+T 4 キ … 十 区 +16k+ 1 に 
Because 216」 二 … 十 1 擬 + 1 了 チ 0, the inequality above implies that 
I7 ー SIl > sk」 ュ ・ 
Thus S = 了 攻 minimizes 7 ー5Sll among 5 と 々 (VW) with dimrangeS < た . 
For other examples of the use of the singular value decomposition in best 
approximation, see Exercise 22, which finds a subspace of given dimension on 


which the restriction of a linear map is as small as possible, and Exercise 27, 
which finds a unitary operator that is as close as possible to a giVen operator. 
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7o/7 の eco77O5777O77 


Recall our discussion before 7.54 of the analogy between complex numbers > 
with | = 1 and unitary operators. Continuing with this analogy, note that every 
complex number z exceDt 0 can be written in the form 


where the first factor, namely, z/|z|, has absolute value 1. 

Our analogy leads us to guess that every operator 7 々 ( じ ) can be written as 
a unitary operator times VT*7. That guess is indeed correct. The corresponding 
result is called the polar decomposition, which gives a beautiful description of an 
arbitrary operator on 

Note that if 了 (の), then 7* ア is a positive operator [as was shown in 


7.64(3)]. Thus the operator VT*7 makes sense and is well defined as a positive 
operator on 

The polar decomposition that we are about to state and prove says that every 
operator on is the product of a unitary operator and a positive operator. Thus 
we can write an arbitrary operator on V as the product of two nice operators, 
each of which comes from a class that we can completely describe and that we 
understand reasonably well. The unitary operators are described by 7.55 TEF =C: 
the positive operators are described by the real and complex spectral theorems 
(7.29 and 7.31). 

Specifically, consider the case F = C, and suppose 


アー 5V7* 了 ア 


is a polar decomposition of an operator 了 と 々 (P), where 5 is a unitary operator. 
Then there is an orthonormal basis of with respect to which 5 has a diagonal 


matrix, and there is an orthonormal basis of with respect to which V7*7 has 
a diagonal matrix. WWarning: There may not exist an orthonormal basis that 
simultaneously puts the matrices of both 5 and V7*7 into these nice diagonal 
forms 一 5 may require one orthonormal basis and V7*7 may reduire a different 
orthonormal basis. 

However (Still assuming thatF = 〇 ), 下 了 is normal, then an orthonormal 
basis of Pcan be chosen such that both 5 and V7*7 have diagonal matrices with 
respect to this basis 一 see Exercise 31. The converse is also true: TT7 と (の ) 
and7 ニー SV7*7 for some unitary operator 5 々 (V) such that 5 and V7*7 both 
have diagonal matrices with respect to the same orthonormal basis of V then 了 
is normal. This holds because 了 then has a diagonal matrix with respect to this 
same orthonormal basis, which implies that 7 is normal [by the equivalence of 
(c) and (a) in 7.31 1. 
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The polar decomposition below is valid on both real and complex inner product 
Spaces and for all operators on those SsDaceS. 


7.93 po/47 eco777O777 の 77 


Suppose 了 々 ( じ ). Then there exists a unitary operator 5 々 () such that 


が 喧 ぶ 7 が 。 


Proof Let s」, .……,s,, be the positive singular values of 了 , and let e」, …, eand 
方, …, 方 , be orthonormal Hists in such that 


7.94 7? = 5s1( の 6) 訂 キ … ナオ 5。( の 6) 訪 


for everyo と V Bxtend e」,…, 6 and 方 ,… 刻 , to orthonormal bases e」, …, 6。, 
and 片 ,…。 訪 OZ 
Define S と 々 ( ぴ ) by 


So = (の 1) 廊 キー オキ ( の 6) 訪 
for eacho と V Then 
ISgl” = og) 訪 +ー+ (og) 訪 
= o+…+Kog 


= lgl? 


Thus 5 is a unitary operator. 
Applying 7* to both sides of 7.94 and then using the formula for 7* given by 
7.77 shows that 
7* ア の ー 5 イ ( の 1)6」 キオ … 十 52( の ,6。)6。 
for every vV Thusifo と then 
V ナ f イ ナー sg1( の 61)6」 キー 十 5。( の の 62 
because the operator that sends o to the right side of the equation above is a 
positive operator whose square eduals 7*7. Now 


SV7*7 = 5(s1( の , 6])6」 オキ … 十 5。( の 26) 


三 s1(《 の 61) 放 キー ナ 5 の 6 の) 訪 
三 7 了 ?, 


where the last equation follows from 7.94. 


Exercise 27 shows that the unitary operator 5 produced in the proof above is 
as close as a unitary operator can be to 

Alternative proofs of the polar decomposition directly use the spectral theorem, 
avoiding the singular value decomposition. However, the proof above seems 
cleaner than those alternative proofs. 
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Ope7g7o7y 4pp/7ed 7o 77 の so75 7 77777e/e の 6 の 5 


The pg7 im of radius 1 centered at 0, denoted by p, is defined by 


B = (o と Y: gl <1). 


Tf dim ソ = 2,the word yis sometimes used instead of 
ヵ g77. However, using ヵ g// in all dimensions is less confusing. 
Similarly, if dim V = 2, then the word e// カ se is sometimes 
used instead of the word e//yo77 that we are about to define. 
Again, using e777 の yo77 in all dimensions is less confusing. 

You can think of the ellipsoid defined below as obtained 
by starting with the ball p and then stretching by a factor of 
sr along each 記 axis. 77e pg/7 BR. 


Suppose that 刻 ,…, 万 1S an orthonormal basis of P and s」, …,5, are DOSitiVe 
numbers. The eso77 E(5 方,…,5。 訪 ) With p7727 の 7 grey 5 方, …, 5。 18 
defined by 


4 雪 
Ke 刻 )| ae の カ | < 


@ に 


0HHAIDSeOGPDP2Rー 尼 E ソ : 


The ellipsoid notation E(5 訪 ,…,5, 万 ) does not explicitly include the inner 
product space even though the definition above depends on However, the in- 
ner product space V should be clear from the context and also from the requirement 
that 刻 ,…, 万 be an orthonormal basis of 区 


7.97 example: e// カ yo7 ゞ 


V2 


77e e// の so77 E(2 方, ) 7 の RS ye7e 77e epso77 E(2 訪 。 ) 7 R2, nyc 


, な 77e sg7dg77 gs75 7 R<^. ニー イエ ユエ ニー イー ユエ エ 
記 , 記 が 方 し 7 の ち ( 8 計 は 
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77,e e// め yo7 の 
E(4 刻 ,3,2 訪 ) RS 
we7e 方 , ち , ちな 7 が e 
sgnd77 ps7s の 7 R1. 


The elliipsoid E( 訪 ,…, 万 ) equals the ball Bim り for every orthonormal basis 
訪 , 方 で [by Parseval's identity 6.30(b)]. 


For 7 了 a function defined on Vand() こ て defne 7(()) by 
7(0①)) = (7o :o6()). 


Thus 了 is a function defined on V then 7() = range7. 

The next result states that every invertible operator 7 々 ( ぴ ) maps the ball 
jp monto an eliipsoid in The proof shows that the principal axes of this 
elliipsoid come from the singular value decomposition of 了 ア 


Proof Suppose 了 has singular value decomposition 


7.100 To = sr の) 廊 キ オー 5 の 6) 刻 


forallo と where s, …,s,, are the singular values of 了 ア and e」,…e, and 訪 ,…, 刻 
are both orthonormal bases of We will show that 7(B) = Es」 方 ,…,5。 刻 ). 

First suppose o  p. Because ア is invertible, none of the singular values 
s,…,5。 eduals 0 (see 7.68). Thus 7.100 implies that 


2 4 
【C50) 時 が ) 


> = | の em) ビ +…ー+ Ko の eg)F く 1. 
51 


7 
Thus 7? と E(5」 方 ,…,5, 訪 ). Hence 7(g) CE(5」 刻 ,…,5。 訪 ). 
To prove inclusion in the other direction, now suppose の 万 (5」 方 ,…,5。 亡 ). 


の el 。 

51 5 
Then |lgll < 1 and 7.100 implies that To = (の 。 片 ) 廊 エー (の 訪 ) ん モ の . Thus 
T(B) 3 表 (5』 衣 5 あ )、 


Let 


7・ 
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We now use the previous result to show that invertible operators take all 
ellipsoids, not just the ball of radius 1, to ellipsoids. 


7.101 72ve77//e ope77O7 7 ん ey e/77 の so75 7 の e7// カ yo75 


Suppose 7 々 () is invertible and is an ellipsoid in V Then 7( ぢ ) iS an 
eliipsoid in 


Proof There exist orthonormal basis 方 ,…, 訪 Of and positive numbers 5] , ……, 5 
such that E ニ E(5」 方 ,…,5。 訪 ). Define 5 と 々 ( ゆ ) by 


S( 族 キー キ 所 訪 ) モ 51 廊 キー オキ の 5 記 
Then 5 maps the ball p of り onto 万 , as you can verify. Thus 
T(E) = 7(S(B)) = (TS)(B). 
The equation above and 7.99, applied to 75, show that 7(E) is an elhpsoid in 


Recall (see 3.9$) thatifz and(〈) こり then zz+() is defmed by 
7 十 () 三 (27 二 の : の の)). 


Geometrically, the sets () and zz + () look the same, but they are in different 
locations. 

In the following definition, if dim ソ = 2 then the word pg7g//e/og74777 1S Often 
used instead of pg7//e/e の 9. 


7.102 definition: P( の 」, …, の,), の 7 の 7/e/6 の 6 の 


Suppose の 」, …, の, 1S a basis of V Let 
(2 に ラジ の IKEaPieoaaetot の NIC 2 まこ RU0U 有 ME 


A pg777e/ep め ed is a set of the form ヵ + ア ( の 」,……, の) for Some と The 
Vectors の , ……,6, aTe called the egey of this parallelepiped. 


7.103 example: pg7//e/ep の 6 の y 
1.5 


0.5 
の | 


0.3 1.3 2.3 
77,e pg7 の 77e/6 の カカ eg の 4 pg7g7/e/eppeg 77 R3. 
(0.3,0.5) + P((1.0), (1, 1))  R2. 
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7.104 72ve77//e ope747 の 7 7 ん ey 7 の 7/e/e6 の の e の 5 72 7 の 77e/6 の 6 の ? 


Suppose 7 三 and の,…, の, 1S a basis of じ Suppose 7 々 () is invertible. 


Then 


(の mM の pe の) 三 002 FU0 の 


Proof Because 7 is invertible, the Hist 7?」,.…,7?, is a basis of V The Hinearity 
of ア implies that 


(寺村 … 寺 本 の) ナル 寺本 ナ の 」 キ … 寺本 す の 
for al ,…,, (0,1). Thus 7(7+ P( の 1 の)) ニ 7 P(7 の 」,…, 7,) 
Just as the rectangles are distinguished among the parallelosgrams in R^, we 


give a specialname to the parallelepipeds in whose defning edges are orthogonal 
to each other. 


7.105 definition: の ox 


Aorin Visa set of the form 
ki(/i ら 1 つの 5 ら 2 


wherez and7,…,7, aTe DOsitive numbers and e」, … 6, 1S an orthonormal 
basis of 


Note that in the special case of R< each box is a rectangle, but the terminology 
ヵ ox can be used in all dimensions. 


7.106 example: orey 


2 ト 


2 V2g 


1 9 有 ! 
77e pox (1.0) + P( V2g, V2e。), We7e 77,e の or P(e], 26。,es), We7e 6 , 6 っ , 6 
ーー 1 = だ コ fy 娘 e sy7g7 の 7 の の gs7y の げ RC. 
生 ( 参り の の の = (一, 5 7e 57g7 の 77 の pgy7y oO の 7 
Suppose 了 と 々 ( じ ) is invertble. Then 7 maps every parallelepiped in 
to a parallelepiped in (by 7.104. In particular, 了 maps every boxinVtoa 
parallelepiped in This raises the question of whether 了 maps some boxes in 
to boxes mn The following result answers this question, with the help of the 
singular value decomposition. 
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7.107 every 7zve77 の 7e oe77 の 7 7 の ん ey yO7776 Ore ゞ 7 の の orey 


Suppose 7 々 () is invertible. Suppose 7 has singular value decomposition 


了 の 王 S1( の , 61) SF Ro 5 の , 2 


where s」,…,5, are the singular values of 了 and e」,…,e, and 方 ,…, 万 are 
orthonormal bases of and the equation above holds for all? と V Then7 
maps the box エア (7 …, 太ら ) Onto the box 7 エア (75」 族 … っ 5 廊 ) for 
all positive numbers 7」,…,7, and all7 


Proof fa,.…,g,。 (0,1) and 7」,…, 7 are DOsitive numbers andz と then 


7 二 776 キー キ の の な ) モイ ルオ の 5 旋 キ ーー オキ の の 5。 刻 


Thus 7(2 エア (の っ 太 )) ニ 7 エア (7]s] 訪 …) 5 刻 ) 


Vo77777e 7 S772g77727 777ey 


Our goal in this subsection is to understand how an operator changes the volume 
of subsets of its domain. Because notions of volume belong to analysis rather 
than to Hinear algebra, we will work only with an intuitive notion of volume. Our 
intuitive approach to volume can be converted into appropriate correct definitions, 
correct statements, and correct proofs using the machinery of analysis. 

Our intuition about volume works best in real inner product spaces. Thus the 
assumption that F = R will appear frequently in the rest of this subsection. 

If dimV = 7 ヵ 7, then by ro/7e we will mean 7-dimensional volume. You 
should be familiar with this concept in R?. When 7 = 2, this is usually called area 
instead of volume, but for consistency we use the word volume in all dimensions. 
The most fundamental intuition about volume is that the volume of a box (whose 
defining edges are by definition orthogonal to each other) is the product of the 
lengths of the defining edges. Thus we make the following definition. 


7.108 definitlon: vo/77e の 7 ox 


SupposeF= ニ R.Ifz リ amnd7」,…,7。 aTe DOSitiVe numbers and e」, .…, 6, 1S 
an orthonormal basis of V then 


volume(4 キア (16 …。 7 ) イメー メア 


The definition above agrees with the familiar formulas for the area (which we 
are calling the volume) of a rectangle in R2 and for the volume of a box in R?. For 
example, the first box in Example 7.106 has two-dimensional volume (or area) 2 
because the defining edges of that box have length V2 and V2. The second box 
in Example 7.106 has three-dimensional volume 2 because the defining edges of 
that box have length 1, 2, and 1. 
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To defme the volume of a subset of approximate the 
subset by a finite collection of disjoint boxes, and then add up 
the volumes of the approximating collection of boxes. As we 
approximate a subset of more accurately by disjoint unions 
of more boxes, we get a better approximation to the volume. Nh。 ニ 

These ideas should remind you of how the Riemann integral ze 7 が な 5 
is defined by approximating the area under a curve by a disjoint pg// sg o7 7e 
collection of rectangles. This discussion leads to the following yo/zes 7 万 e 
nonrigorous but intuitive definition. ny ores. 


7.109 definitlon: yo/z777e 


SupposeF =Rand()CV Then the yo/z7ze of (), denoted by volume〈), is 


approximately the sum of the volumes of a collection of disjoint boxes that 
approximate (). 


We are ignoring many reasonable questions by taking an intuitive approach to 
Volume. For example, if we approximate () by boxes with respect to one basis, 
do we get the same volume we approximate () by boxes with respect to a 
different basis7 If ()」 and ()。 are disjoint subsets of is volume(()」 り ()」) = 
volume()」 + Volume ()。7 Provided that we consider only reasonably nice subsets 
of techniques of analysis show that both these questions have afhrmative 
answers that agree with our intuition about volume. 


7.110 example: vo/z772e Cge の y g 7e7 7 の の 


Suppose that 了 と 々 (R2) is defined by 
了 o ー 2( の , e)e」 十 (の , 6。)e。, where e」, e。 1S the 
standard basis of R<. This linear map stretches 
by a factor of 2 along the e」 axis. The ball 
approximated by five boxes above gets mapped 
by 7 to the ellipsoid shown here. Each of the 
five boxes in the original figure gets mappedto Pc poxr 7e7e Zs nzce 7 が e 7 の 7 
a box of twice the width and the same heisght gz 7 娘 e sg7ze eg77 g5 7e の ores 7 
as in the original figure. Hence each box gets 7 用 42477/ 人 放 /447742 
mapped to a box of twice the volume (area) as in the original figure. The sum 
of the volumes of the five new boxes approximates the volume of the elliipsoid. 
Thus 了 chanees the volume of the ball by a factor of 2. 


In the example above, 7 maps boxes with respect to the basis e」, e。 to boxes 
with respect to the same basis: thus we can see how 了 changes volume. In general, 
an operator maps boxes to parallelepipeds that are not boxes. However, if we 
choose the right basis (coming from the singular value decomposition!), then 
boxes with respect to that basis get mapped to boxes with respect to a possibly 
different basis, as shown in 7.107. This observation leads to a natural proof of 
the following result. 
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7.111 yo/z772e cg72gey の y 9 /2c7O7 7 77e /7 の gd7/c7 の 7 娘 e 772677727 774ey 


SupposeF = R,7 ア と () is invertible, and() て CV Then 


Volume 7(()) = (product of singular values of 7) (Volume ()). 


Proof Suppose 了 has singular value decomposition 
7 = s1( の ,61) 放 キー ナオ 5 の ,6) 訪 


forall の と where e」,…, 6 and 訪 ,…, 亡 are orthonormal bases of 

Approximate () by boxes of the form 7+ ア (7e」,…。 6 ), Which have volume 
7 ※ メ …x 了 7. The operator 了 maps each box Pe … 6 ) Onto the box 
7 + の (7]s] 方,… っ 5 訪 ), which has volume (5」xX… xs5.)(71 メー…※ カ ). 

The operator ア maps a collection of boxes that approximate() onto a collection 
of boxes that approximate 7(()). Because 7 chanees the volume of each box in a 
collection that approximates ( ) by a factor of s」 x … xs,, the Hinear map 了 changes 
the volume of () by the same factor. 


Suppose 7 と (). As we will see when we get to determinants, the product 
of the singular values of ア equals Idet7|: see 9.60 and 9.61. 


7o/e777e ゞ の 7 77 の の @7 の 7O7 gy の e7e77777776 の y 775 7ge72V7/7ey 


We conclude this chapter by presenting the table below. The context of this 
table is a finite-dimensional complex inner product space. The first column of 
the table shows a property that a normal operator on such a space might have. 
The second column of the table shows a subset of C such that the operator has 
the corresponding property if and only f all eisenvalues of the operator he in 
the specified subset. For example, the frst row of the table states that a normal 
operator is invertible if and only 症 all its eigenvalues are nonzero (this first row 
is the only one in the table that does not need the hypothesis that the operator is 
normal). 

Make sure you can explain why all results in the table hold. For example, 
the last row of the table holds because the norm of an operator equals its largest 
singular value (by 7.83) and the singular values of a normal operator, assurmning 
F = C, equal the absolute values of the eigenvalues (by Exercise 7 in Secton 7E). 


properties of a normal operator eigenvalues are contained in 


invertible GU 

self-adjoint R 

skew {AEC:Re ル = テ 0) 
orthogonal projection {0,1)} 

DOSitive [0, co) 

unitary {AEC:|A=1) 
norm is less than 1 {AEC:IA< く <] 
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re7c7yey // 


10 


11 


12 
13 


14 


Prove that if 5. 了 と Z 尼 WW),then | SI MMl <|HSー7. 


77,e 77e94 の 7 の の ove 7 Cg77e 77e 7eDe7ye 7777576 7776774777 の か. 


Suppose that ア 々 ( ぴ ) is self-adjoint or thatF =Cand 李 と ん ( ゆ ) is 
normal. Prove that 


IT = max 人 Al : ん is an eisenvalue of 7}. 
Suppose 了 と W) ando と び . Prove that 
I7gl =I7IIgl < 連 7P7o = HIPo. 


Suppose 了 と (WW),o と and 7 = 上 Ilgl. Prove thatifz と and 
( ヵ の, の) 三 0, then (77, 7 の ) = 0. 


Suppose is a finite-dimensional inner product space, 7 と ん ( け ), and 
5 と 々 (人 , W). Prove that 


IEMIE 当 MIMIE 
Prove or give a counterexample: If 5.7 と 々 ( ゆ ), then IS7I| = IT7SI 


Show that defining 7(5, 了 7) = |S 一 攻 for 5,7 と ん 々 (V W) makes 7 a metric 
on 々 (W). 

777o ere7C/Se 75 7777677 の eg 7 の 7 7eg の e7y 7O g7e /7777777 777 7776777C SC@S 
(a) Prove thatif7 と 〆( ぴ ) and 選 ーー 7 < 1, then 7 is invertible. 


(b) Suppose that 5 ん () is invertible. Prove that 了 々 () and 
IS - 7 < 1/|S- 衝 , then 7 is invertible. 


7775 ee7c75e SOwy 如 7 777e se7 O/ 772De777 の /e Ope7 の 7 の 7 7 ( ソ ) 75 72 の Pe7 
sz の ye7 7 ん (), 4y77g 7 が e 77e77C の e7776 772 万 Ye7cC7e /. 


Suppose 7 々 (). Prove that for every e > 0, there exists an invertible 
operator 5 と 々 ( ツ ) suchthat0< く | デー5Sll<e. 


Suppose dim ソ > 1and ア 7 と ん () is not invertible. Prove that for every 
e > 0, there exists 5 々 (Y) suchthat0<| 上 ll<eandSisnot 
invertible. 


SupposeF = Cand 了 ア 7 と る ( ゆ ). Prove that for every e > 0 there exists a 
diagonalizable operator 5S と 々 (V) suchthat0<|ーSll<e. 


Suppose 7  () is a positive operator. Show that 7 | 三 VI7I. 
Suppose 5,7 と 々 () are positive operators. Show that 
IS- 尋 <maxflSILIH7U < IS + 


Suppose U and W are subspaces of V such that IPr, 一 Pr < 1. Prove that 
dim = dim W. 


15 


16 


17 


18 


19 


20 


21 


22 


23 


24 
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Define 7 と (FE?) by 
了 (Z」,2 っ , 2 ) 三 (2Z3,221, 322). 
Find (explicitly) a unitary operator S と (FE?) such that 了 = 5V7* 子 . 


Suppose 5 々 ( ぴ ) is a positive invertible operator. Prove that there exists 
6 > Osuchthat 了 is a positive operator for every self-adjoint operator 
了 7 と ズ ( ゆ ) with IS 一 基く 6. 


Provethatifz ヒ Vand @, is the Hnear functonal on V defined by the 
equation の ,, (の ) 三 (の , 7), then lg, 放 = 
刀 e7e ye 7e 77727725 の 7e ycg/27 7e/7 F 2 72 7777767 7 の の 7 の Ce 7 
(w,) = w/ g77 w, FE. 7745 | の | 7e725 77e 7 の 777 の 7 の , 9 777eg7 
7 の 7o77 V 7o E. 
Suppose e」,…,6, 1S an orthonormal basis of ソ and 了 7 バル W). 
(@) Prove that maxtl7erl,…。I7e) < IT < (上 Te 上 P+…+I7eMP) 
(b) Prove that IT = (ITP+…+I7eP)-i 誕 and only dimrangee7<1. 


刀 e7e e」,…,6。 75 7 97 の 777 0777O7O777797 gy7y の 7 7 の 7 ecesSg77 が CO7- 
7ec7e の 777 9 572g777 vg の 7e の eco77 の 5777O7 の 7 了 アガ 5],…,5。 7 7e /757 
の yg2727 vg7esy の 7 了 ア , 7e77 7e 776777 se の げ 77e 72e974977 の か の の ove eg の /9 
(5 イキ …+ 52) 2 gy ws so 7 rerc7se 77() 如 Sec7io7 


Prove thatif7 EZ W), then |7*7| = HI7I に 
77s め 777774 7 7T /eg の 5 7o 7 が e の 2DO77g777 y の 7ec7 の 7 C*-g7ge の 775. 


Suppose 了 と 々 (D) is normal. Prove that 7 人 = 7 for every positive 
integer た . 


Suppose dimV > 1 and dim W > 1. Prove that the norm on 々 ( W) does 
not come from an inner product. In other words, prove that there does not 
exist an inner product on 々 (V W) such that 


maxfI7ol :o と andlgl < 1) = V( ア 7) 
for al 了 7 と (WV). 


Suppose 了 と (WW). Let 7 = dm ソ and let s、 > … > s, denote the 
singular values of 7. Prove that if 1 < たく < ヵ , then 


minf 人 ll : is asubspace ofVwith dim プ = 記 =5_ 計 1. 


Suppose 7 (VIW). Show that 7 is uniformly continuous with respect 
to the metrics on and MW that arise from the norms on those spDaces (see 
Exercise 23 in Section 6B). 


Suppose 7 と 々 ( ぴ ) is invertible. Prove that 


了 
I7 プ = MI) 本 is a unitary Operator. 
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Fix ビザ withz 子 0.Defne 7 々 () by To = (⑦, の for everyo モ WV 
Prove that 


V イ 7 の ニ ME 7)7 


_ 央 
for everyo と 


Suppose 7 と 々 (). Prove that 7 is invertible if and only if there exists a 
unique unitary operator 5 々 (V) such that 了 ーー SV7 ポ 7. 


Suppose 了 々 () and 5s」,…, 5, are the singular values of 7. Let e」,…,e。 
and 片 ,…, 万 be orthonormal bases of such that 
7? = s1( の 0) カキ オー 5 の 6) 訪 


for allgz と V Defne 5 と 々 () by 


So テニ ( の em) 放 エー オキ (の 6) 記 . 
(&) Show that S is unitary and 7 一 SI = maxtls」 一 1|, .…, js 一 11). 
(b) Show that ifE と ん ( ゆ ) is unitary,then 7 一 骨 > 有 ーー5Sl|. 


77775 ere7C/Se 77775 9 777777y の の @77 の 7 5 777 75 5 C/Ose 5 の yy の /e (77O77g 
77e 7777777Y の の @7 の 7 の 7 ゞ ) 7 の 9 g7Ve77 の の @7 の 7 の 7 


Suppose 7 々 ( ゆ ). Prove that there exists a unitary operator 5 々 (の) 
such that アー V ソ 7 ナイ *5. 


SupPose 7 々 (). 

(a) Use the polar decomposition to show that there exists a unitary operator 
S と の ( ぴ ) such that 7 アテ ニー 657*75 そ 

(b) Show how (a) implies that 7 and 7* have the same singular values. 


Suppose 7 々 ( ゆ ), 5 々 () is a unitary operator, and AR 三 ん ( ぴ ) is a 
positive operator such that 7 = SR. Prove thatR = V7*7. 
777s ere7C7se SO 7 が 47 が We W777e 了 了 の y 77e 7 の gd7/C7 の 7 の 7727777 ツ の /67 の 7 の 7 
7 の  /O577 が Ve O/@7 の 7 の 7 (の ゞ 777 77 の O/27 deco7 の OS777o77 /. の 93), 太 e77 77e 
の 5777Ve O/@7 の 7 の 7 64975 V7*7. 


SupposeF = Cand 李 と とく ( ゆ ) is normal. Prove that there exists a unitary 
operator 9 と 々 ( じ ) such that 7 = SVT*7 and such that 5 and V7*7 both 
have diagonal matrices with respect to the same orthonormal basis of 


Suppose that 7 と 々 (WW) and 了 7 0. Let s」,.…,s5,。 denote the positive 
singular Values of 了 . Show that there exists an orthonormal basis e] ,…, 6 


of (null7)~ such that 
7(C さ > る )) 
5 


eduals the ball in range ア of radius 1 centered at 0. 


Chapter 8 3 


Ope747O7y O72 CO77 の /er Vec7O7 SC@y 


In this chapter we delve deeper into the structure of operators, with most of the 
attention on complex vector spDaces. Some of the results in this chapter apply to 
both real and complex vector spaces: thus we do not make a standing assumption 
thatF =C. Also, an inner product does not help with this material, so we return 
to the general setting of a fimite-dimensional vector sDace. 

Even on a finite-dimensional complex vector space, an OpDerator may not have 
enough eigenvectors to form a basis of the Vector space. Thus we will consider the 
closely related objects called seneralized eieenvectors. We will see that for each 
operator on a fnite-dimensional complex vector space, there is a basis of the Vector 
Space consisting of generalized eigenvectors of the operator. The generalized 
eigenspace decomposition then provides a good description of arbitrary operators 
on a finite-dimensional complex Vector SDace. 

Nilpotent operators, which are operators that when raised to some Dower 
equal 0, have an important role in these investigations. Nilpotent operators provide 
a key tool in our proof that every invertible operator on a fimite-dimensional 
complex vector space has a sduare root and in our approach to Jordan form. 

This chapter concludes by defining the trace and proving its key properties. 


57g7777g Gy57477 の 77O775 /O7 75 Cp/67 


e F denotes R or C. 
e "denotes a fimite-dimensional nonzero Vector space OVer F. 


川 人 M 川 。 


1 ーー WW ワ 
伯 吊 剛 ー 吊 る 
守 


の 


77e oe Aoo77 の 7 が e 0/7 7 の 7g7y の 7 7 が e (077pe7y7 が y の の 77 we7e WZ/77777 万 272777 の 7 
(76805-7665) gy @ 5747e777 7 の 77e72 9 cy 776777 の e7. 77777 の 77 の 7 の Ve の 7 ?/eC7/ Cy@ 
の 7 gd7 ye 77OW Cg/7 77e Cy/eyー 万 77777o7 77eo7e777 77 7653. 


@⑥ Sheldon Axler 2024 207 
S. Axler, eg7 47gep7g の o7ze 7g77。 Undergraduate Texts in Mathematics, 
https://doi.org/10.1007/978-3-031-41026-0_8 
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84 Ce7e777<eg 7ge77Vec7O7y 77 の /V7 の o7e777 ひ /e77O7y 


zz// Spgces O7 oe7y O/ 477 ひ /e7 の 7 の 7 


We begin this chapter with a study of null spaces of powers of an operator. 


.1 seg97@72Ce の 7 77C76 の 7728 777777 5 の の cey 


Suppose 7 ん ( ゆ ). Then 


{0) = null79 て null7T て … こ て null7 チ C null 7K+1 て …. 


Proof Suppose た is a nonnegative integer ando null7 た Then 7 = 0, 
which implies that 7 1o ニア (To) = (0) = 0. Thus o null7 パ 1 Hence 
null7* て null 7 なす 1 as desired. 


The following result States that 下 Wo の 7 y77777727 76y77775 の o777 dec7e57779 
consecutiVe terms in the seduence ofsub-  。。 enCey の 7 7 の ges, yee 太 e7cises 6, 
spaces above are equal,then all later Zzz8 
terms in the sequence are edual. 


8.2 egg/77y 7 77e ye974672Ce の 7777/ y の cey 
Suppose 7 々 () and 77 is a nonnegative integer such that 


null77 ーー null 7 の ト 1 


nul77 ニー null 7 ダキ 1 nul1 7 の 712 ニ nul177 の 13 ニ … 


Proof Let た be a positive integer. We want to prove that 
al な nl WPWYA 


We already know from 8.1 that null 7 の た て null 7 の キ は 1 
To prove the inclusion in the other direction, suppose o null771+1 Then 


0 キ Po) ー 7 の 二 た キ 1 の ー0. 


Hence 
7Ko null 7 の 7 キー nul17 字 


Thus 7"+Ao = 77(7 人 の) = 0, which means that o null7"+K This implies that 
null77+ 人 は 1 て nu1177+ た completing the proof. 


The result above raises the question of whether there exists a nonnegatiVe 
integer 77 such that null 7 ニ null77+1 The next result shows that this equality 
holds at least when 7 equals the dimension of the vector space on which 了 
ODerates. 
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8.3 777 5gcey 7 の の 87 の 777g 


Suppose 7 ん ( ゆ ). Then 


null dm ー null dm Sall null dmY+2 前 


Proof We only need to prove that null7m ソ ニョ ul179mV+1 (by 8.2). Suppose 
this is not true. Then, by 8.1 and 8.2, we have 


0 で 中 下 で で an C iTS 


where the symbol C means “contained in but not equal to': At each of the 
strict inclusions in the chain above, the dimension increases by at least 1. Thus 
dimnull7"m ソ +1 > dim 1, a contradiction because a subspace of V cannot 
have a lareer dimension than dim 


It is not true that ソ =null ア 7@range 了 for every 7 と 々 (V). However, the 
next result can be a useful substitute. 


8.4 V 記 7 如 e の 7ec7 s777 の null79mY の range 79mY 


Suppose 7 々 (). Then 


=nnull79mY 6rangeT9mV 


Proof Let7 = dimV Hirst we show that 
8.5 (mull77) n (range 7”) = (0). 


Suppose の (null77?) n (range77). Then 7"o = 0, and there exists z 
such thato = ニア 7"z. Applying 7" to both sides of the last equation shows that 
77o ニア 2 Hence 7277, ニー 0, which implies that 7 = 0 (by 8.3). Thus 
の = イア" = 0, completing the proof of 8.5. 

Now 8.5 implies that nul1l7 ア ェ range7" is a direct sum (by 1.46). Also, 


dm(nul77” @range77) = dimnull7"+ dimrange イ "= dim 


where the frst equality above comes from 3.94 and the second equality comes 
from the fundamental theorem of linear maps (3.21). The equation above implies 
that null7"@ranse7" ニ リザ (see 2.39), as desired. 


For an improvement of the result above, see Exercise 19. 


8.6 example:F* ニ null7? @range7? 太 77 と イ (EP) 
Suppose 7 と (E?) is defined by 


了 (Z」, 2 っ 。 Z。 ) ヒー (422, 0, 2 . 
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Then null7 = 人 {(Z」,0,0) : z」 と F) andrange ア ニ {人 (z」,0,2。) : Z],Z。  F}. Thus 
nul イ アロ range7 チ {0}. Hence null 了 ザ + range7 is not a direct sum. Also note that 
null イ 了 + range7 チ E* However, we have 人 = (0,0,125z。). Thus we 
see that 


null7? ニ 人 {(z,2)0) : Zr,22 F) and range7?7= 人 (0,0,z。) : z。 と FE]). 
Hence F*=null73 の range7? as expected by 8.4. 


Ce7e7 の 77<e 万 7ge77VeC7 の 7 


Some operators do not have enough eigenvectors to lead to good descriptions of 
their behavior. Thus in this subsection we introduce the concept of generalized 
eigenvectors, which will play a major role in our description of the structure of an 
operator. 

To understand why we need more than eigenvectors, let's examine the question 
of describing an operator by decomposing its domain into invariant subspaces. Fix 
了 アー と ズ ( ゆ ). We seek to describe 7 by finding a “nice” direct sum decomposition 


= @…@ し し, 


where each is a subspace of invariant under 了 . The simplest possible nonzero 
invariant subspaces are one-dimensional. A decomposition as above in which 
each ル is a one-dimensional subspace of V invariant under 了 is possible if and 
only ザ ソ has a basis consisting of eigenvectors of ア (see 3.55). This happens 
and only has an eigenspace decomposition 


8.7 = E(A1,7) @…@ PA), 


where 4」, …, 和 ん, are the distinct eigenvalues of ア (see 5.53). 

The spectral theorem in the previous chapter shows thatif is an inner product 
Space, then a decomposition of the form 8.7 holds for every self-adjoint operator 
if ギニーR andfor every normal operator ifF = C because operators of those types 
have enough eigenvectors to form a basis of (see 7.29 and 7.31). 

However, a decomposition of the form 8.7 may not hold for more general 
operators, even on a complex vector space. An example was given by the operator 
in 5.57, which does not have enough eigenvectors for 8.7 to hold. Generalized 
eigenvectors and generalized eigenspaces, which we now introduce, will remedy 
this situation. 


8.8 definition: ge72e7 の 77<e 6e7ge77V@C7O/ 


Suppose 7 6 々 ( じ ) and ん is an eisenvalue of 了 . A vector の と Viscalled a 
ge74@7 の 77<eg e7ge77V@C7O7 Of 7 corresponding to ん 聞 0 and 


7ー4D=0 


for some positive integer た . 
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ん nonzero Vectoro リザ 1iS a general- Ce7e777<e e7ge77V2/7/6y 76 72O7 ge- 
ized eigenvector of 7 corresponding to ん 大 eg ecgrse opg yoO wo or /eg の 
導 andonly 7 の 7y7 が ge egso7・ が (アー AD な 

7ー AD9mVo = 0. 75 7 の 7 776C7ZVe / の 7 90 0042 777@- 
ge7 ん た 77e7 アー 人 Js 7 の 07 77/ec7 が ye, 7 の 
ece 人 ル 75 72 @7ge72774e の 了 ア 


as follows from applying 8.1 and 8.3 to 
the operator 7 ー 47. 

As we know, an operator on a complex Vector space may not have enough 
eigenVectors to form a basis of the domain. The next result shows that on a 
complex vector space there are enough generalized eigenvectors to do this. 


8.9 の 575 の 7 ge767 の 7<e e79677D6C7 の 7 ゞ 


SupposeF = Cand ア 7ー ン ( ゆ ). Then there is a basis of V consisting of 
generalized eigenvectors of 7 


Proof Letz = dmV We will use induction on 77. TO get started, note that 
the desired result holds if ヵ = 1 because then every nonzero Vector in is an 
eigenVvector Of 了 ア | 

NoW suppose ヵ > 1 and the de- 77775 57e/ 75 Ye7e Ye 6 7e DO77ey7y 
sired result holds for all smaller valnes 訪 4/F = C, pecgze が F = Rez ア 
of dimV Let ル be an eigenvalue of 了 7 訪 の 7o7 7Zve の 7y ege7vg/ey 
Applying 8.4 to アー 47 shows that 


=nul ザ アー の)" @range ゲ 7ー ス 7 人 


THfnull7 ア 7ー ル 4) アニ テリ then every nonzero vector jn V is a generalized eigen- 
Vector of 了 , and thus in this case there is a basis of consisting of generalized 
eigenvectors Of 了 . Hence we can assume that null7ー47)7 チ which implies 
that range7ーA7) ア 7 チ {0). 

Also, null(7ー ル 4 の)" チ {0}, because is an eigenvalue of ア . Thus we have 


0 <dimransee7ー4D)7< く が. 


Furthermore, range(7ーA7)7 is invariant under 了 [by 5.18 with p(zZ) = (zー)7 
Let 5 と (range7 ーー AD”) equal 7 restricted to range(7 ーー A7) Our induction 
hypothesis applied to the operator 5 implies that there is a basis ofrangee ザ ー47)" 
consisting of generalized eigenvectors of 5, which of course are generalized 
eigenvectors of ア . Adjoining that basis ofrange(7ー47)7 to abasis of null ザ 7ー47)7 
gives a basis of consisting of generalized eigenvectors of 


HfF=Randdim リ > 1, then some operators on V have the property that 
there exists a basis of V consisting of generalized eigenvectors of the operator, 
and (unlike what happens when F =C) other operators do not have this property. 
See Exercise 11 for a necessary and sufficient condition that determines whether 
an operator has this property. 
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8.10 example: ge7e7g/7<ed ege7zvec7 の ry の 7 7 の De727O7 7 
Defne 7 と (で?) by 


了 (Z」, 2 っ ,Z。) 三 (42。, 0,52。 ) 


for each (<」,z っ ,2。) と で" Aroutine use of the definition of eigenvalue shows that 
the eigenvalues of 7 are 0 and 5. Furthermore, the eigenvectors corresponding to 
the eigenvalue 0 are the nonzero Vectors of the form (z」, 0,0), and the eigenvectors 
corresponding to the eigenvalue 5 are the nonzero vectors of the form (0, 0, z。). 
Hence this operator does not have enough eisenvectors to span its domain で 

We compute that 0 2 ろ ,Z。) 三 (0,0,125z。). Thus 8.1 and 8.3 imply that the 
generalized eigenvectors of 了 corresponding to the eisenvalue 0 are the nonzero 
vectors of the form (z」,Z。,0). 

We also have (7ー 1 と の 2 っ ,2s) (一 125z」 + 300z。, 一 125z。, 0). Thus the 
generalized eigenvectors of 了 corresponding to the eisenvalue 5 are the nonzero 
Vectors of the form (0, 0, z。). 

The paragraphs above show that each of the standard basis vectors of C? is a 
generalized eigenvector of 了 ア . Thus で ? indeed has a basis consisting of generalized 
eigenvectors of 了 , as promised by 8.9. 


Tfois an eigenvector of 々 (V), then the corresponding eigenvalue ル is 
uniquely determined by the equation 7o = Ao, which can be satisfied by only one 
ん EE (becauseo チ 0). However, 半 ? is a generalized eigenvector of 了 , then it 
is not obvious that the equation 7 ー 47)9mYo = 0 can be satisfied by only one 
A ce F. Fortunately, the next result tells us that all is well on this issue. 


8.11 ge7ze7g/7ze e7ge77VeC7 の 7 CO77@5O77 ゞ 7 の の 77277746 6796777/74e 


Suppose 7 々 ( り ). Then each seneralized eiegenvector of 7 corresponds to 
only one eisenvalue of 7 ア * 


Proof Supposeo リ is a generalized eigenvector of correspondine to eigen- 
values wand ル of ア . Let 7 be the smallest positive inteser suchthat 7ーw7)7"o =0. 
Let ヵ = dimV Then 

0= ザ ダー4D り "の 
(7ーgD+( み 一 "の 


II 


> (*ー27 ま アーgDAp, 
た =0 


where 5 = 1 and the values of the other binomial coefhcients do not matter. 
Apply the operator (7ーa7)7ー] to both sides of the equation above, getting 


0=(w 一 2)77 ーー1o. 


Because (7 ー 7) ゲ ーー 0,the equation above implies that z = 人, as desired. 
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We saw earlier ($.11) that eisenvectors corresponding to distinct eisenvalues 
are hnearly independent. Now we prove a similar result for generalized eigen- 
Vectors, with a proof that roughly follows the pattern of the proof of that earlier 
result. 


8.12 /7eg77 7 の de の e72 の 6777 ge7767 の 77<e e7ge77V@C7 の 7 


Suppose that 7 三 々 (). Then every Hist of generalized eiegenvectors of 了 
corresponding to distinct eigenvalues of is linearly independent. 


Proof Suppose the desired result is false. Then there exists a smallest positive 
integer 77 such that there exists a linearly dependent list の 」, …, の ,, Of generalized 
eigenvectors of 7 corresponding to distinct eigenvalues 4」,…, 4。 of (note that 
7 > 2 because a generalized eieenvector is, by definition, nonzero). Thus there 
exist 7, …, の F, none of which are 0 (because of the minimality of 7), such 
that 

9 の 1 の … 二 の の 三 0. 


Let ヵ 7 = dimV Apply 7ー ル の "to both sides of the equation above, getting 
8.13 gg (ブール の 7 の キー キー ュー ブ ナー ル の 7 ュ テ 0. 
Suppose た {1,.…,7 一 1). Then 
Tー ん の "ok チ 0 


because otherwise o, would be a generalized eigenvector of ア corresponding to 
the distinct eigenvalues A, and 人 ん, which would contradict 8.11. However, 


ザーADY( ゲ ー ル の "eo) モミ ブール 2.D の 7(ー 447)7o) = 0. 


Thus the last two displayed equations show that (ザー ル の 7 1S a generalized 
eigenvector of 7 corresponding to the eigenvalue ん ,. Hence 


ーー44DPoTー 4 の Po 


is a hnearly dependent list (by 8.13) of カー1 generalized eigenvectors correspond- 
ing to distinct eigenvalues, contradicting the minimality of 7 ヵ . This contradiction 
completes the proof. 


7 の o7e777 ひ /e777 の 7y 


8.14 definition: 77/o7e777 


An operator is called zo7e77 if some power of it equals 0. 


Thus an operator on Vis nilpotent 半 every nonzero Vector in is a generalized 
eigenvector of 了 corresponding to the eigenvalue 0. 
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8.15 example: 777 の の 7e777 の の 67 の 7 の 7? 
(a) The operator 了 と 々 (E?) defined by 
了 (Z], 2 っ, ZZ4) 三 (0,.0,2],Z。) 
is nilpotent because 7 テニ 0. 


(b) The operator on F* whose matrix (with respect to the standard basis) is 


-3 9 0 
ー-7 9 6 
4 0 -6 


is nilpotent, as can be shown by cubing the matrix above to get the zero matrix. 


(c) The operator of differentiation on 少 ,(R) is nilpotent because the (77 uu 
derivative of every polynomial of degree at most 77 equals 0. Note that on 
this space of dimension 77 + 1, we need to raise the nilpotent operator to the 
power 77 + 1 to get the 0 operator. 


The next result shows that when Tais- 
ing a nilpotent operator tO a DOWer, We 
never need to use a Dower higher thanthe yg power 77 7po7e77 /7e7g/ が か 
dimension of the space. For a slightIy 。 訪 zzzs zzg power 太 7 が 5 ze7 の . 
Stronger result, see Exercise 18. 


77,e 7777 WO7 の 7 77/ 7776 の 75 770777775 の 7 
<@7 の , 777e 777 WO7⑦ の 7672S 77767725 


8.16 77 の o7e777 De77O7 727S6 7 の 77776757O72 の 7 の o777777 75 0 


Suppose 7 々 ( ゆ ) is nilpotent. Then 79mY ニ 0. 


Proof Because 7 is nilpotent, there exists a positive integer た such that 7* = 0. 
Thus null7 サ ニ Now 8.1 and 8.3 imply that null7m ソ ニヤ Thus 79m ソ 0. 


8.17  e7ge7zvg/7zey の 7 777/ の O76777 O の 7 の 7O7 


Suppose 7 々 (). 


(a) 7 ア is milpotent, then 0 is an eigenvalue of 7 and 7 has no other 
eigenValues. 


(b) IE = で and 0 is the only eigenvalue of 了 了 , then 7 is nilpotent. 


Proof 


(a) 10 prove (8), suppose 了 iS nilpotent. Hence there is a positive integer 77 such 
that 7 ゲー0. This implies that 7 is not injective. Thus 0 is an eigenvalue 
of ア 
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To show that 7 has no other eigenvalues, suppose 人 is an eigenvalue of 了 ア . 
Then there exists a nonZero Vectoro  V such that 


Ao = J 了 の . 
Repeatedly applying 7 to both sides of this equation shows that 
Ao = ニ 7T"o =0. 
Thus ル = 0, as desired. 


SupposeF=Cand0isthe only eigenvalue of7. By 5.27(b), the minimal 
polynomial of ア equals z" for some positive integer 77. Thus イ "ツー0. Hence 
7 is nilpotent. 


(b 


ヽ ュ ン 


Exercise 23 shows that the hypothesis thatF =Ccannot be deleted in (b) of 
the result above. 

Given an operator on we want to find a basis of V such that the matrix of 
the operator with respect to this basis is as simple as possible, meaning that the 
matrix contains many 0's. The nextresult shows that エ 了 is nilpotent。 then we can 
choose a basis of V such that the matrix of 了 with respect to this basis has more 
than half of its entries equal to 0. Later in this chapter we will do even better. 


8.18 77777727 Po/y7707727/ 777 7/ の 67-7772977747 7777777 の 7 7777 の の 76777 の の 77 の 7 


Suppose 7 と 々 ( ゆ ). Then the following are equivalent. 
(a) is nilpotent. 


(b) The minimal polynomial of ア is z7" for some positive integer 77. 


(c) There is a basis of 『 with respect to which the matrix of has the form 


考 旨 


where all entries on and below the diagonal equal 0. 


Proof Suppose (a) holds, so is nilpotent. Thus there exists a Dositive integer 
rsuchthat イ "= 0. Now 5.29 implies that z" is a polynomial multiple of the 
minimal polynomial of 了 ア . Thus the minimal polynomial of ア is z7 for some 
positive integer 77, Droving that (a) implies (b). 

Now suppose (b) holds, so the minimal polynomial of ア is z" for some positive 
integer 77. This implies, by 5.27(a), that 0 (which is the only Zero of z7) is the 
only eigenvalue of 7 This further implies, by 3.44, that there is a basis of with 
respect to which the matrix of イア is upper triangular. This also implies, by 5.41, 
that all entries on the diagonal of this matrix are 0, proving that (b) implies (c). 

Now suppose (c) holds. Then 5.40 implies that 7 ソニ 0. Thus 7isnilpotent, 
proving that (c) implies (8). 
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1 Suppose 7 と ( じ ). Prove that 導 dim nul17 和 = 8and dim null7? = 9, then 
dimnull7 ア ツー9for all integers 77 > 5. 


2 Suppose 7 と 々 ( ゆ ), 7 is a positive integer,o  V,and 7 ツー!o 子 0but 
77 ヵ = 0.Prove that o,7o, 7 の, …77ー1o is linearly independent. 
777e 7es777 7 7775 eXe7C7Se 7 6 の 7 77e p7oo/ の 7 9. プ 5. 
3 Suppose 了 と 々 ( ゆ ). Prove that 
=null イ erange7 < っ null72 ニ null 巡 


4 Suppose 7 と 々 ( ゆ ), 4 6 F, and 77 is a positive integer such that the minimal 
polynomial of 了 is a polynomial multiple of (< 一 系 Prove that 


dimnul(7ー ル AD) アッ 嫌 . 
S Suppose 7 と ( ぴ ) and 7 is apositive integer. Prove that 


dimnull77 < 7 dim null 7. 
万 777- 万 Ye7c7se 27 77 Sec77o7 3 7 の y の e 5e774/. 


6 Suppose7 と 々 ( ぴ ). Show that 
=range7" つ range7T つ … つ range7* つ range7 は 1 つ …. 
7 Suppose 7 と 々 ( ぴ ) and 7 is a nonnegative integer such that 
range 7 ニ range 77 キ 1 
Prove that range7* = ニ range 7 for all た > 7. 


S Suppose 了 と て ( ゆ ). Prove that 
rangeTdm ソ V ニ range7mV+1 range TTPmVT2 二 …. 
9 Suppose 7 と 々 ( ぴ ) and 娘 is a nonnegative integer. Prove that 
null 7 ー null 7 の ツキ 1 こう range7 字 ニ range 了 の + エ 


10 Define 了 と 々 (で?) by 7( の ,z) = (<,0). Find all generalized eigenvectors 
of ア 


11 Suppose that 了 々 ( ゆ ). Prove that there is a basis of V consistng of 
generalized eigenvectors of 7 and only if the minimal polynomial of 7 
eduals (z 一 AA」)…(z 一 ん ) for some A,…, ん 4。 FE. 

人 AsseF ニーR の ecgzse ecgseF = で C ん /7owy 方 o77 う .27( の ) gz 8.9. 

777s ere7C7Se 5776y 777 太 e co7 の 77O7 727 7e7e 7 の の eg の yy が co75757777g 
の ge7@7 の 77<eg 67ge74VeC7O7 ゞ の 7 7 が な 娘 e yg7776 5 77e co7 の 777o7 67 77e7e 7 の /e 
g の 5 が 7 7es の ec7 7 の 7C7 2 7 の 67-777772577727 27 (yee う . プ イイ). 
Cgz7 の 7・ が ア 72y の 7 4 の Pe た 7777267477 772777Y 7 7e5 の ec7 7 の の の 579 
の ],… っ の, の 7 ゆ 太 e72 の 」 75 72 @7g672VeC7 の 7 の 7 了 の 7 7 75 7707 776C@SS77 が の 776 
万 27 の っ , …, の 。 の 7 867267777Zed e7ge77Vec7 の 7y oO/ アア 


12 


13 
14 
15 


16 


17 


18 


19 


20 


21 


22 


23 


24 


25 
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Suppose 7  ( げ ) is such that every vectorin is a generalized eigenvector 
of 了 7. Prove that there exists AF such that アー 47 is nilpotent. 


Suppose 5,7 と 々 ( ゆ ) and 57 is nilpotent. Prove that 7S is milpotent. 
Suppose 7 と 々 ( ぴ ) is nilpotent and 了 チチ 0. Prove ア is not diagonahzable. 


SupposeF =Cand ア 7 と る ( ゆ ). Prove that 7 is diagonalizable if and only 
every generalized eisgenvector of ア is an eigenvector of 了 ア 


or F = C, 娘 /5 eXe7C7/ye 5 77 の 777e7 e の 777D/e74Ce 7 の 777e 7757 の 7 co7777 の 775 
7 ん 7 geo7g77zg の 7777 の 77 う .55. 


(a) Give an example of nilpotent operators 5, 了 on the same vector sDace 
such that neither S+ 了 nor 5 is milpotent. 

(b) Suppose 5,7 と 々 () are nilpotent and 5 アニ 5S. Prove that 5+ 了 and 
S7 are nilpotent. 


Suppose 7 々 (げじ ) is nilpotent and7is apositiveinteger suchthat イ T"=0. 


(a) Prove that7ー7isinvertible and that 7 一 7)- ト ニー リィ + ォ アキ ー ェ 7 アート 
(b) Explain how you would guess the formula above. 


Suppose 7 了 と 々 ( ツ ) is nilpotent. Prove that 7 9mrange7 ニ 0. 


が dimransee ア 了 <dim ソ ー 1 7 娘 e7 75 ere7c7Se 7 の 7 の Vey ひ . 70. 


Suppose 7 と 々 ( ぴ ) is not nilpotent. Show that 


= null7dm ザ ー1 の range 7 fm ザー ュ 


Oo7 oO の 67 の 7 の 7 ゞ 777 7 74O7 777 の の 76777, 77779 ee7C/Se 7 の 7 の Vey 6. プ . 


Suppose V is an inner product space and 了 7 と () is normal and nilpotent. 
Provethat ア =0. 


Suppose 7 と 々 ( じ ) is such that null79m ソ ツー1 nul179mV Prove that ア is 
nilpotent and that dim null 7k た for every integer た with 0 < た < 中 m ソ 


Suppose 7 と 々 (C?) is such that range7* range7”. Prove that ア is 
nilpotent. 


Give an example of an operator 7 on a finite-dimensional real vector sDace 
such that 0 is the only eisenvalue of ア but 了 is not nilpotent. 
777y ere7c7se yowy 7747 77e 7 の 77cg7o7 (の ) = っ (@) 7 8.7Z oey 7 の 7 7o77 
Wo7 77e が の 7 が ey7s 娘 27F =C. 


For each item in Example 8.13, fmd a basis of the domain Vector space such 
that the matrix of the nilpotent operator with respect to that basis has the 
upper-triangular form promtsed by 8.18(c). 


Suppose that Vis an inner product space and 了 イズ ( ゆ ) is nilpotent. Show 
that there is an orthonormal basis of V with respect to which the matrix of 
has the upper-triangular form promised by 8.18(c). 
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6 Ce7e777<eg 7ge77yD の Ce の eco777 の OS777O77 


び e776777<e 万 7ge775 の の C@y 


_8.19 definition: ge7ze7g/7<eg e7ge745pgce, G(A, 了 ) 


Suppose 7 々 (P) and ん EE. The se7e7g/Zzeg e7ge74? の ce Of 了 correspond- 
ing to A, denoted by G(A, ず ), is defined by 


G(A,7) = (の モリ : 7ーAD)o = 0 for some positive integer 紀 . 


Thus G(A, 李 ) is the set of generalized eigenvectors of 7 corresponding to 
along with the 0 vector. 


Because every eigenvector of 7 is a generalized eigenvector of ア (take た = 1 
in the defmnition of generalized eigenvector), each eigenspace 1S contained in the 
corresponding generalized eigenspace. In other words, アー ん ( ゆ ) and 和信 ビ 王 , 
then E( 和 ん,7) て G(A, ず ). 

The next result implies that if7 と 々 ( じ ) and ん EE, then the generalized 
eigenspace (ん , 了 ア ) is a subspace of V (because the null space of each hnear map 
on is asubspace of の ). 


8.20 gesc7/ カ 77O72 の 7 ge7767@/7<eg e7ge775 の の C6y 


Suppose 7 々 () and AE. Then G(A, 了 ア ) = null(7 ー 47)9mY 


Proof Supposeoenull7 ア ーA7D9PY The definitions imply co  G(A,7). Thus 
G(47) つ null7ー 427 

Conversely, suppose の G( ん 了 ). Thus there is a positive integer た such 
thatonull ア ーA7D た From 8.1 and 8.3 (with 7 ー A7 replacing 7), we get 
enull イ アーA7)9mV Thus G(A7T) て null アーA7)9mV completing the proof. 


8.21 example: ge7,e7/Z<e e7ge775 の PC6 ゞ の 7 72 の /67g7O7 o77 で " 


Defne7 と 々 (で?) by 
了 (Z1, 2 っ , 2。 ) 一 (422, 0,5z。). 


In Example 8.10, we saw that the eigenvalues of are 0 and 5, and we found 
the corresponding sets of generalized eisgenvectors. Taking the union of those sets 
with {0}, we have 


G(0.7) = 人 (],25,0) : 1,22 と で ) and G(5,77) = 人 (0,0,z。) : z。 で}. 
Note that で = G(0,7) @ G(5,77). 
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In Example 8.21, the domain space で " is the direct sum of the generalized 
eieenspaces Of the operator in that example. Our next result shows that this 
behavior holds in general. Specifically, the following major result shows thatif 
F=Cand ア 7 と ん ( ゆ ), then is the direct sum of the generalized eiegensDaces 
of 了 , each of which is invariant under 7 and on which ア is a nilpotent operator 
plus a scalar multiple of the identity. Thus the next result achieves our goal of 
decomposing into invariant subspaces on which has a known behavior. 

As we will see, the proof follows from putting together what we have learned 
about generalized eigenspaces and then using our result that for each operator 
了 と イズ (), there exists a basis of V consisting of generalized eigenvectors of 


8.22 ge7ze7g/7<eg e7ge775D の Ce の ecCO777 の OS777O77 


SupposeF = Cand7 と (ゆり). Let 4 , …, ん , be the distimct eigenvalues 
of 7 Then 


(&) G( ん Az, 了 7) is invariant under 7 for each た = 1,.…77: 


(b) ゲール Ac 7) 1S milpotent for each た = 1,…,7 が : 
(c) =G(41.7) @… @ G(A。, 7). 


Proof 
(a) Suppose た {1, .……,7). Then 8.20 shows that 
GA。 の) = mm アー ADTY 
Thus 5.18, with ヵ (Z) = 隊 こ AOTW implies that G(A。 了 ア ) is invariant under 了 , 
Proving (8). 


Suppose た {1, .……,77). To 三 G( ん AL, ず ), then (7 ー MO の 三 0 (by 8.20). 
Thus (7 ー 0ue) = 0. Hence ザー 和 Ace.7) 35 nilpotent 
proving (D). 


(b 


ヽ ュ ン 


(c) 1o show that G(A1, プ ) +…+ G( ん 4, ア ) 1S a direct sum, SUDDOSe 
の 」 キ … キ の ニ リ 0, 


where each Zr is in G(A ル ん 7) Because generalized eiegenvectors of 了 cor- 
responding to distinct eigenvalues are Hnearly independent (by 8.12), this 
implies that each or equals 0. Thus G(41,7) キー G( ん 7) is a direct sum 
(by 1.45). 


Finally, each vector in can be written as a fimite sum of generalized eigen- 
Vectors of7 (by 8.9). Thus 


Proving (C). 


For the analogous result whenF = R, see Bxercise 8. 
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7777 の 77c7 の の 77 7ge72v の 777e 


T Vis a complex vector space and7 と る 々 ( ゆ ), then the decomposition of pro- 
vided by the generalized eigenspace decomposition (8.22) can be a powerful tool. 
The dmensions of the subspaces involved in this decomposition are sufhciently 
important to get a name, which is given in the next definition. 


8.23 gefinition: 7 の /7c7 が の 


e Suppose 7 々 (). The 7 の 7c7 が y of an eigenvalue of is defined to 
be the dimension of the corresponding generalized eigenspace G( 和 ん , 了 ). 


e In other words, the multiplcity of an eisenvalue 人 of equals 


situlll 議 00kLuM00 


The second bullet point above holds because G( ん , 了 了 ) = null イ アザ アール 7 )dmY (see 
8.20). 


8.24 example: 7 の 7c7 カ の の 7 egC77 e7ge72V/746 の / 77 の の 67 の 7 の 7 


Suppose 7 了 と (で?) is defined by 


The matrix of ア (with respect to the standard basis) is 


6 3 4 
0 6 2 | 
0 0 Z 


The eigenvalues of ア are the diagonal entries 6 and Z, as follows from 5.41. You 
can verify that the generalized eisenspaces of 7 are as follows: 


G(6,7) = span((1,0,0), (0, 1.0)) and G(7, ア ) = span((10,2, 1)). 


Thus the eigenvalue 6 has multplciy 2 訪 sx 7p/e。 の ep の 666 
and the eigenvalue 7 has multiplicity 1. ezgevg/e eg/s 放 e 7 の er の 7 太 7es 
The direct sum で = G(6,77) @ G(7.7) 訪 7 @e7ge77V の 7776 の の 675 O72 77e 72gO- 
is the generalized eigenspace decom- ヵ 7 o7gz 4 の Pe/-772g777 7 の が 7 の P- 
position promised by 8.22. A basis 7@ ゞ 6727777 777e De797 の 7: 7777y の eV7O7 
of C? consisting of generalized eigen-  g/gys ppens, gs ye 7 see 如 8.37. 
Vectors of 了 , as promised by 8.9, is 

(1,0,0),(0,1,0),(10,2,1). There does not exist a basis of C? consisting of eigen- 
Vectors of this operator. 


In the example above, the sum of the multplicites of the eigenvalues of 
eduals 3, which is the dimension of the domain of 7. The next result shows that 
this holds for all operators on finite-dimensional complex vector sDaces. 
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8.25 sz777 の 娘 e 777777 の 77c777ey eg475 dim レ 


SupposeF = Cand7 々 ( ゆ ). Then the sum of the multiplicities of all 
eisenvalues of ア equals dim 


Proof The desired result follows from the generalized eigenspace decomposition 
(8.22) and the formula for the dimension of a direct sum (see 3.94). 


The terms 4/ge/7g7c 77777 の 7c77y and geo7e77C 7274777 の 7 の are used in some 
books. In case you encounter this terminology, be aware that the algebraic multi- 
plicity is the same as the multiplicity defined here and the geometric multiplicity 
is the dimension of the corresponding eisenspace. In other words, if 了 と 々 (の ) 
and A is an eigenvalue of 了 了 , then 


algebraic multplicity of ル = dimnul( イ 7 ー 47 )dm ソ ニー dim G(A.7), 
geometric multiplicity of 4 = dimnull(7 ー 27) = dim PE( ん 本). 


Note that as defined above, the algebraic multiplicity also has a geometric meaning 
as the dimension of a certain null space. The definition of multiplicity given here 
is cleaner than the traditional definition that involves determinants: 9.62 implies 
that these defimitions are equivalent. 

T Vis an inner product space, 7 と 々 (V) is normal, and 人 is an eigenvalue 
of 了 了 , then the alsgebraic multiplicity of A equals the geometric multiplicity of A, 
as can be seen from applying Exercise 27 in Section 7A to the normal operator 
ー47. As a special case, the singular values of S モ と 々 (WW) (here and W are 
both finite-dimensional inner product spaces) depend on the multiplicities (either 
algebraic or geometric) of the eigenvalues of the self-adjoint operator 5*S. 

The next definition associates a monic polynomial with each operator on a 
jimite-dimensional complex Vector sDace. 


8.26 definition: cg7c7e77977C OO77777 


SupposeF = Cand 了 と 々 (). Let A」, .……, ん denote the dstinct eigenvalues 
of 李 , with multiplicites 9」,… の The polynomial 


(ター41)5…(gー ん )7 


is called the c77gc7e77577C の oy72 の 7777/ Of 了 


8.27 example: 77e C727 の 7677577C の の 7 の 777797 の 7 72 の の @7 の 7 の 7 


Suppose 7 と 々 (で ?) is defined as in Example 8.24. Because the eigenvalues of 
7 are 6, with multplicity 2, and 7, with multiplicity 1, we see that the characteristic 
polynomial of ア is (< 一 6)^ 々 Zー グ ). 
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8.28 geg7ee 7 <e7Oy O/ c77277C7677577C の の /7207777/ 


SupposeF = Cand ア 7 イズ ( ゆ ). Then 


(a) the characteristic polynomial of 7 has degree dim じ : 


(b) the zeros of the characteristic polynomial of 7 are the eisenvalues of 7 


Proof Our result about the sum of the multplicites (8.25) implies ( ぉ ). The 
definition of the characteristic polynomial implies (b). 


Most texts define the characteristic polynomial using determinants (the two 
definitions are equivalent by 9.62). The approach taken here, which is considerably 


simpler, leads to the following nice proof of the Cayley-Hamilton theorem. 


8.29 Cgy/ey-- 刀 4777777O7 77eO7e777 


SupposeF = C, 7 (ぴの ), and 7 is the characteristic polynomial of 7, Then 
(7) = 0. 


Proof Let A」, …, ん, be the distinct eigenvalues of 了 , and let = dim G(AL 7). 
For each た {1, .…, 7), we know that 7ー Ac の is nilpotent. Thus we have 


AD 生 に AA の ゎ =0 AA77777 C の /ey (7627-7695) pz2/ 記 7e の 
還 777ee 777d777e777777CS の の の 67 ゞ の @/ の 7 CO777- 


(by 8.16) for each た 1,…。 が } ア /e777g 75 772 の 6797777/776 の eo7ee. 


The generalized eisgenspace decom- 
position (8.22) states that every vector in "is a sum of vectors in 
G(A1, ず の ),… G(4 ル の) Thus to prove that 97) = 0, we only need to show 
that 77)|c 7) モ 0 for each た た 

Fix 古人, .……, 嫌 ). We have 


7(7) ニニ (ザー 4 の 后 …(7 ー ん の 


The operators on the right side of the equation above all commute, so we can 
move the factor (7 ー AD) 和 to be the last term in the expression on the right. 
Because (7 ー AD の ー 0, we have 9①)|cAL の ) 三 0, as desired. 


The nextresultimplies thatif the minimal polynomial of an operator ア と 々 (の ) 
has degree dim (as happens almost always 一 see the paragraphs following 5.24), 
then the characteristic polynomial of 了 equals the minimal polynomial of 7 


8.30 c/Z7c7e77577C の の 77 の 777777 75 6 77277777 の /e O/ 77777777427 の 77707777/ 


SupposeF = Cand ア 7 と ( り ). Then the characteristic polynomial of 了 is a 
polynomial multiple of the minimal polynomial of 7 ア | 


Proof The desired result follows immediately from the Cayley-Hamilton theo- 
rem (8.29) and 3.29. 
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Now we can prove that the result suggested by Example 8.24 holds for all 
operators on finite-dimensional complex Vector SDaceS. 


8.31 77 の 77c77y の 7 72 67ge77D7774e 67775 7277777 の e7 の 7 777776 ゞ 077 の 72gO77g/ 


Suppose FE = Cand 了 7 と ズバ ( ゆ ). Suppose の 」, …, の, 1S a basis of such that 


77 (, (の の, …。 の ,) ) 1S upper triangular. Then the number of times that each 
eieenvalue ルル of 7 appears on the diagonal of 7 (7, (6」,.…, の ,) ) equals the 
multiplicity of 人 as an eigenvalue of 7 ア 


Proof Let 4 = 77(7, (の ],… の) ). Thus 4 iS an upper-triangular matrix. Let 
A」,.…, ん ル , denote the entries on the diagonal of 4. Thus for each た {1,.…,7}, 
We have 

To 友人 ん の み 


for some z, SDan( の ],…, の Cr_- ュ ). Hence iT た 1.…,7) and ん, 了 チ 0, then 7or is 
not a Hinear combination of 7?」,…, 7. The linear dependence lemma (2.19) 
now imples that the Hist of those To such that ん , 了 チ 0 is Hnearly independent. 

Let 9 denote the number of indices た 人 1,.…,7) such that 人 = 0. The 
conclusion of the previous paragraph implies that 


dimranee7 テ カー 
Because 7 = dim ソ = dimnull ア 7+ dim range 了 , the ineduality above implies that 
8.32 dimnul7< 


The matrix of the operator 7" with respect to the basis o」, …, の, 1S the uDDer- 
triangular matrix 47 which has diagonal entries で,.…, ル [see Exercise 2(b) in 
Section SC]. Because A/ = 0if and only ん, = 0, the number of times that 0 
appears on the diagonal of 4" equals 9. Thus applying 8.32 with 了 replaced with 
7 we have 


8.33 dimnull77 < マガ 


For ル an eigenvalue of 李 , let 娘 denote the multiplicity of ル as an eigenvalue 
of 了 and let 9。 denote the number of times that 4 appears on the diagonal of 4. 
Replacing 了 in 8.33 with ア ー ん 7, we see that 


8.34 7 < の 


for each eieenvalue ル of 了 . The sum of the multiplicities 7 、 Over all eigenvalues 
ん of ア 7equals ヵ , the dimension of V (by 8.2S). The sum of the numbers 9 、 oVer 
all eisgenvalues ん of 了 also equals 7, because the diagonal of 4 has length 7. 

Thus summing both sides of 8.34 over all eigenvalues ル of ア produces an 
eduality. Hence 8.34 must actually be an equalty for each eigenvalue 人 ル of 刀 
Thus the multiplicity of A as an eisgenvalue of ア equals the number of times that 
A appears on the diagonal of 4, as desired. 
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/oc ん の 7Zgo7g/ 74777Cey 


To interpret our results in matrix form, の 7 の 2 02 00 0 
we make the following definition, gener-  /7zy の 放 罰 太 g の 7 gy co7poseg の 
alizing the notion of a diagonal matrix. 。/s//e7 77Zces. 

Tf each matrix 4, in the definition below 

is a 1-by-1 matrix, then we actually have a diasonal matrix. 


8.35 definition: /oc ん 2g の 7 の 7 7277 克 


A //oc の ggo7g7/ 27 が 1S a square matrix of the form 


| 」 | 
0 久 際 


where 4」, …, 4 are square matrices lying along the diagonal and all other 
entries of the matrix equal 0. 


8.36 example: 6 //oc 7 の go74/7 77777 


The 5-by-5 matrix 


(4 ) 0 0 0 0 
0 2 -3 0 
4 ニテ 0 0 2 ) 0 
0 0 0 
0 0 0 0 1 ) 
is a block diagonal matrix with 
イ 」 0 
4 = 45 
0 4。 


where 


4」=(4 ), な =[ 。 4 なこ [ 。 」」 


Here the inner matrices in the 5-by-5 matrix above are blocked off to show how 
we can think of it as a block diagonal matrix. 


Note that in the example above, each of 4」, 4。, 4。 is an upper-triangular 
matrix whose diagonal entries are all equal. The next result shows that with 
respect to an appropriate basis, every Operator on a fimite-dimensional complex 
Vector space has a matrix of this form. Note that this result gives us many more 
Zeros in the matrix than are needed to make it upper triangular. 


Section BB Generalized Eigenspace Decomposition 315 


8.37 7//oc ん 2go747 7 が 7777 7 の 67-77472g7477 の /Oc ん y 


SupposeF = Cand7 と (ゆり). Let 4 , ……, ん , be the distinct eigenvalues 
of 了 ア , with multiplicities 本 ,… 7 の. Then there is a basis of with respect to 
which 7 has a block diagonal matrix of the form 


| 。 | 
0 2 し 


where each 4, is a 必 -by- み upper-triangular matrix of the form 


ん 
人 
0 
Proof Bach ザ デール)|c 7) 35 nilpotent (see 8.22). For each た , choose a basis 
of G( ん の), which is a Vector space of dimension み , such that the matrix of 
ザール の に 7) With respect to (his basis is as in 8.18(c). Thus with respect to 
this basis, the matrix of の, which eduals 7ー ル cu タオ Ac 7 の 
looks like the desired form shown above for 4,. 
The generalized eigenspace decomposition (8.22) shows that putting together 


the bases of the G(4,, 子 )"s chosen above gives a basis of The matrix of 了 with 
respect to this basis has the desired form. 


8.38 example: //ocX 72gO7 の 7 7777777X D7 867267 の 77Zeg e7ge77VC7 の 7y 


Let 7 と 々 (で ?) be defined by 了 (Z],2 っ ,Z。) 三 (6Z」 32。 二 4z。, 62。 二 22。, ZZ。) . 
The matrix of ア (with respect to the standard basis) is 


6 3 4 
0 6 2 1, 
0 0 Z 


which is an upper-triangular matrix but is not of the form promised by 8.37. 
As we saw in Example 8.24, the eisenvalues of are 6 and 7Z, and 


G(6,7) = span((1,0,0),(0,1,0)) and G(7,7) = span((10,2, 1) ). 


We also saw that a basis of C? consisting of generalized eigenvectors of 7 is 
(1,0.0), (0,1. 0), (10,2,1). 


The matrix of ア with respect to this basis is 


59 | 
0 0 (7?Z) 


which is a matrix of the block diagonal form promised by 8.37. 
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re7c7yey 6 ア 


10 


11 


Defne 7 = /(C^) by 7(<op,z) = (一 2, の ). Find the generalized eigensDaces 
corresponding to the distinct eisenvalues of 7 


Suppose 7 々 (げじ ) is invertible. Prove that G(A, ア ) = G( Mg 叶 for every 
ん と Fwith 和 信子 0. 


Suppose 7 々 ( ゆ ). Suppose 5 と 々 ( ゆ ) is invertble. Prove that ア and 
5-17S have the same eigenvalues with the same multiplicities. 


Suppose dim リ > 2and7 と ( ゆ ) is such thatnull 7 ソー タテ nul1l 79m ソ ー ト 
Prove that 7 has at most two distinct eisenvalues. 


Suppose 了 々 (V) and 3 and 8 are eigenvalues of ア . Let ヵ = dimV Prove 
that ソ =(null7"ー タ 2) @ (range 77ー う ). 


Suppose 7 々 (げじ ) and ん is an eigenvalue of 了 ア . Explain why the exponent 
ofz 一 Ainthe factorization of the minimal polynomial of ア is the smallest 
positive integer 77 Such that 7ー Ac 7 モリ 0. 


Suppose 了 々 () and ん is an eigenvalue of with multiplicity 9. Prove 
that G(A, ア ) = null(7 ー A7)% 
が g』 < dim V 娘 e7 如 s ere7c7se 7 の 7 の Vey 6.20. 


Suppose 7 々 (げじ) and A」, …, ん are the distinct eiegenvalues of 了 . Prove 
that 

=G(4 れ 1 子 ) @… @ G(4 の ) 
if and only if the minimal polynomial of equals (ター 44)…(z 一 和え) 
for some positive integers た 」 , .…, ん 。. 


77e cgyeF = C 7/27/oy 777726gd77e/y 方 7 う .27( の ) 7 の 万 e ge77e7g/7<e の 
678e775 の Ce eco774 の OS777O77 (6⑤.22) 77745 775 ere7C75e 75 777676S77725 の 777y We7 
F =R. 


SupposeFE = Cand7 と ( ゆ ). Prove that there exist り ,M 々 () 
such that ア ニテ リロ +A', the operator リ is diagonahizable, AN is milpotent, and 
り M = の. 


Suppose V is a complex inner product space, e」, …, 6, 1S an orthonormal 


basis of 了 ア , and 了 と 々 ( ゆ ). Let A」, .…, ん ん, be the eigenvalues of 了 , each 
included as many tmes as its multiplicity. Prove that 


2 2 2 2 
際 ド キキ MFI キャー ャ MM だ 
See 77e Co77772677 の 7e7 Ye7C7Se う 772 Sec7 の 7 /4. 


Give an example of an operator on C* whose characteristic polynomial 
eduals ( 々 一 7)^( ヶ 一 8)^ 


12 


13 


14 


15 


16 


17 


18 


19 


20 


21 
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Give an example of an operator on C* whose characteristic polynomial 
eduals (ー1)(z 一 5)* and whose minimal polynomial equals (一 1)(z 一 5)^ 


Give an example of an operator on C* whose characteristic and minimal 
polynomials both equal z(z 一 1)2(z 一 3). 


Give an example of an operator on で * whose characteristic polynomial equals 
z(z 一 1)^( ヶ ーー3) and whose minimal polynomial equals z(z 一 1)(z 一 3). 


Let7 ア be the operator on C* defined by 7(z」,2 っ , 2 ぉ ,24) 三 (0,Z」, 2 っ , Zs). Find 
the characteristic polynomial and the minimal polynomial of ア . 


Let 了 be the operator on C? defined by 
了 (Z」, っ > 3 4 ッ > 5 Z。) に (0, る ] > シク 0, る 4 ッ > 0). 
Find the characteristic polynomial and the minimal polynomial of 7. 


SupposeF = CandP と の ( じ ) is such thatP デ ニア Prove that the characteris- 
tic polynomial of Pis z7(z 一 1 where 77 = dimnull and ヵ = dimranee 万 


Suppose 了 々 () and ル iS an eigenvalue of 7. Explain why the following 

four numbers equal each other. 

(a) The exponent of z 一 Ain the factorization of the minimal polynomial 
of 7. 

(b) The smallest positive integer 77 such that ザー ルル = テ 0. 

(c) The smallest positive integer 77 such that 


nul イ アー247) グ nu アー 47)71 
(d) The smallest positive integer 77 such that 
ranee7ーA7D) ゲ グー ニ r ィ ange7ーA7D7 の 1 


SupposeF = CandS と () is a unitary operator. Prove that the constant 
term in the characteristic polynomial of 5 has absolute value 1. 


Suppose thatF =Cand の ,…,, are nonzero subspaces of V such that 
= テリ @…@,. 


Suppose 了 と 々 () and each is invariant under 7. For each た , 1et p, 
denote the characteristic polynomial of 覆し. Prove that the characteristic 
polynomial of ア equals の. 


SupPose , 9 三 の (C) are monic polynomials with the same zeros andisa 

polynomial multiple of p ヵ . Prove that there exists 7 と (Cs9) such that 

the characteristic polynomial of 了 ア is 7 and the minimal polynomial of キア is か 
777y ere7C7Se 7 の /7ey 77747 eVe7y 7 の 777C の O/77O77777/ 7S 77e C77 の 7C7677577 
の 7 の 777/7 の yO7776 の の @7 の 7 の た 
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22 Suppose 4 and pare block diagonal matrices of the form 


23 


0 B。 0 
4 = 和 , #= ー… 
0 2 の 0 B,。 


where 4, and jp, are square matrices of the same size for each = 1,.…,77. 
Show that 4pis a block diagonal matrix of the form 


4 = 和 
0 4 


SupposeF =R, 了 7 と (ゆり ),and AEC. 


(⑧) 
⑪) 


(⑥) 


(⑨ 


Show that g+EG(A,7c) 下 and only if ヵ -ー の と G(A.7). 

Show that the multiplicity of ん as an eigenvalue of 7- equals the 
multiplicity of ル as an eigenvalue of 7 て . 

Use (b) and the result about the sum of the multplicities (8.23) to show 
that if dim is an odd number, then 7。 has a real eigenvalue. 

Use (c) and the result about real eisgenvalues of 7 (Exercise 17 in 
Section 5A) to show that if dimVis an odd number, then 7 has an 
eigenvalue (thus giving an alternative proof of 5.34). 


See 万 Ye7C7Se 3 777 Sec77O7 3 7 77e の e777777O77 の 7 77e co7 の ex が cd77O7 7 て. 
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8C Co7se の 677C@ey の 7 Ce776777<eg 太 7ge775 の gce eco777O ゞ 77 の 7 


S9747e Oo75 O/ pe7 の 7 の 7 ゞ 


Recall that a sduare root of an operator 了 と 々 () is an operator RE ( ぴ ) such 
that RS ニア (see 7.36). Every complex number has a square root。 but not every 
operator on a complex vector space has a square root. For example, the operator 
on で ? defined by 了 (z1, ク の, Zs) 三 (2 っ , Zs, 0) does not have a square TOOt, aS YOU aTe 
asked to show in Exercise 1. The noninvertibility of that operator is no accident, 
as we will soon see. We begin by showings that the identity plus any nilpotent 
operator has a square root. 


8.39 7de777 の の 45 777/ カ 76777 27 ゞ の y974776 7 の 7 


Suppose 7 々 ( ゆ ) is nilpotent. Then リ + ア has a square root. 


Proof Consider the Taylor series for the function V1+r: 


8.40 1+ ャ ニー1 二 テオ の 2 二 …、 


We do not find an explicit formula for 
the coefhcients or worry about whether 
the infinite sum converges because We 
use this equation only as motivation. 

Because 7 is nilpotent 7"ー0for 
some positive integer 77. In 8.40, suppose we replace x with ア and1 with7. Then 
the infinite sum on the right side becomes a finite sum (because 7* = 0 for al 
た ヶ > 7 の ). Thus we guess that there is a square root of リ + ア of the form 


ecg74ye 2] 三 ッ 77e /277777772 の ove 
7 の /7ey 777 1 ぅ 75 の OO の 65777776 


7 V1 + we72 75 777977. 


7 リ + オ gg7 キ の 7 テキ ー オ 17 の ー ト 1 


Havings made this guess, We can try to choose g], 5, っ の,ー1 SUch that the operator 
above has its square equal to リ + ア , Now 


人 MM も も O0 Pe の 


+ (24。- ュ オ terms involving gg っ)7 ゲー 


We want the right side of the equation above to equal 了 + ア . Hence choose 21 
such that 27」 = 1 (thus g」 = 1/2). Next。 choose /。 such that 2g。 4 0 (thus 
の 三 ー178). Then choose g。 such that the coeffcient of7? on the right side of 
the equation above equals 0 (thus z。 = 1/16). Continue in this fashion for each 
た = 4,.…, カ 一 1,at each step solving for z。 so that the coefcient of 7* on the right 
side of the equation above equals 0. Actually we do not care about the explicit 
formula for the 7 's. We only need to know that some choice of the Ss gives a 
sduareroot ofJ+ 好 | 
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The previous lemma is Valid on real and complex Vector spaces. However, the 
result below holds only on complex vector spaces. For example, the operator of 
multiplication by 一 1 on the one-dimensional real vector space R has no square 
root. 

For the proof below, we need to know that every z と Chas 2 
a sduare root in C. To show this, write 


Z ニ 7 げ (cos の 7sin の ), / 


where 7 is the length of the Hine segment in the complex plane 
from the origin to z and 9is the angle of that line segment with 2 
the positive horizontal axis. Then 


ep7@56777777O74 
V7(cos 5 +7sin 5 ) の 7 @ co74 の 7er 
7777 の e7 777 
is a square root of z, as you can verify by showing that the square po7G7 


of the complex number above eduals z. coo7777769. 


8.41 oye7 C, 77ve777 の /e O/e77 の 7 72e y774776 7 の 07 ゞ 


Suppose V is a complex vector space and 了 と 々 (げじ ) is invertble. Then ア has 
a SdUaTe TOOt. 


Proof Let A」, .……, ん 。 be the distinct eigenvalues of 了 ア . For each た there exists a 
nilpotent operator 7 て (G( 和 A。 子 ) ) such that 7 に) ニモ 4 リ + ル [see 8.22(c)] 
Because 了 is invertible, none of the A's equals 0, so we can write 


3 
cu の 王 ん, 7 十 0 


for each . Because 7,/A, is nilpotent, 7 + 攻 /A, has a square root (by 8.39). 
Multiplying a square root of the complex number ん, by a square root of 7+ 也 / ん えん 
we obtain a square root が of 本 の 

By the generalized eieenspace decomposition (8.22), a typical vectoro ヒレ 
can be written uniquely in the form 


の 三 4 十 … 二 7 


where each is in G(4, 了 ア ). Using this decomposition, define an operator 
と 々 ( ゆ ) by 
Ko =ー KR キー 二 信 7。・ 


You should verify that this operator is a square root of 7, completing the proof. 
By imitating the techniques in this subsection, you should be able to prove that 


i 証 is a complex vector space and 7 と (P) is invertble, then 7 has a root 
for every positive integer た . 
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7 の 27 7O7777 


We know that ザ is a complex vector space, then for every 7 と 々 (V) there is a 
basis of with respect to which 7 has a nice upper-triangular matrix (see 8.37). 
In this subsection we will see that we can do even better- 一 there is a basis of レ 
with respect to which the matrix of ア contains 0's everywhere except possibly on 
the diagonal and the Hine directly above the dagonal. 

We begin by looking at two examples of nilpotent operators. 


8.42 example: 777 の の 7e777 の の @7 の 7 の 7 7777 777Ce 772777 


Let 7 be the operator on C* defined by 
了 (Z」, っ ぅ 3 Z4) 三 (0, る ] ッ 2 ッ > 2 ). 


Then 7 テニ 0:thus ア is nilpotent. Ifo = (1.0,0,0), then 7?o, 7 の , 7 の , の is a basis 
of C* The matrix of 7 with respect to this basis is 


0 1 0 0 
0 0 1 0 
0 0 0 1 
0 0 0 0 


The next example of a mlpotent operator has more complicated behavior than 
the example above. 


8.43 example: 7 の の 7e777 の の @797 の 7 7777 sg777 の 77 の 76 CO77 の 7cg76 774777 ア 


Let 7 be the operator on C? defined by 
了 (Z」, っ 。 る 3 る 4 ッ > 5 26) ビー (0, る ] > 2 っ 。 0, る 4 ッ 0). 


Then 7? = 0: thus 7 is nilpotent. In contraast to the nice behavior of the nilpotent 
operator of the previous example, for this nilpotent operator there does not exist 
avectoro  C6such that 75o,74o. 73o,72o, To の is a basis of C6 However, if 
we take ?」 = (1,0,0,0,0,0), の 。 = (0,0,0, 1,0,0), and ?。 = (0,0,0,0,0,1), then 
72o」, 7o], の], 7 の っ の >, の 3 1S a basis of C6 The matrix of 7 with respect to this 
basis is 


0 1 0 0 0 0 

| 0 0 0 
0 0 0 0 0 0 
0 0 0 0 1 0 
0 0 0 生 U 6 
0 0 0 0 0 (0) 


Here the inner matrices are blocked off to show that we can think of the 6-by-6 
matrix above as a block diagonal matrix consisting of a 3-by-3 block with 1's on 
the Hine above the diagonal and 0's elsewhere, a 2-by-2 block with 1 above the 
diagonal and 0's elsewhere, and a 1-by-1 block containing 0. 
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Our next goal is to show that every nilpotent operator 了 々 ( じ ) behaves 
similarly to the operator in the previous example. Specifically, there is a finite 
collection of vectors ?」 , …, の, V such that there is a basis of V consisting of 
the vectors of the form 77o,, as た varies from 1 to 7 and / Varies (in reverse order) 
from 0 to the largest nonnegative integer 77, Such that 7"ko。 了 チ 0. With respect to 
this basis, the matrix of 了 looks Hike the matrix in the previous example. More 
specifically, 7 has a block diagonal matrix with respect to this basis, with each 
block a square matrix that is 0 everywhere except on the line above the diagonal. 

In the next definition, the diagonal of each 4, is fled with some eigenvalue 
Ar of 子 , the line directly above the diagonal of 4, is flled with 1's, and all other 
entries in 4, are 0 (to understand why each ル , is an eieenvalue of 子 , see 5.41). 
The ん A's need not be distinct. Also, 4, may be a 1-by-1 matrix (ん,) containing 
Just an eigenvalue of 了 . Hf each A, is 0, then the next definition captures the 
behavior described in the paragraph above (recall that ギア is nilpotent, then 0 is 
the only eisenvalue of 7). 


8.44 definition: /277277 の 7y 


Suppose 7 々 ( ゆ ). A basis of is called a 7o7d477 の gy7y for 了 症 With respect 
to this basis 7 has a block diagonal matrix 


し “ | 
0 ん 


in which each 4, is an upper-triangular matrix of the form 
由 
4 三 


Most of the work in proving that every operator on a fimite-dimensional com- 
plex vector space has a Jordan basis occurs in proving the special case below 
of nilpotent operators. This special case holds on real vector spaces as well as 
complex Vector SDaceS. 


Proof We will prove this result by induction on dimV To get started, note that 
the desired result holds if dimV = 1 (because in that case, the only nilpotent 
operator is the 0 operator). Now assume that dimV > 1 and that the desired result 
holds on all vector spaces of smaller dimension. 
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Let 77 be the smallest positive inteser such that7”" ー 0. Thus there exists 

gr と Vsuch that 77ー17 0.Let 
= span( ヵ 7 7 アー の) 

The list 。 7 … 7 ゲー177 is linearly independent (see Exercise 2 in Section 8A). 
ff ロニ = リ then writing this list in reverse order gives a Jordan basis for 了 and we 
are done. Thus we can assume that プチ 

Note that is invariant under 7. By our induction hypothesis, there is a basis 
of thatis aJordan basis for |,. The strategy of our proof is that we will find a 
subspace W of Vsuch that W is also invariant under 了 and ソ ニーロ @ W. Again 
by our induction hypothesis, there will be a basis of W that is a Jordan basis for 
TI. Putting together the Jordan bases for | and 7, we will have a Jordan 


basis for 
Let ゅ と be such that e(7"ー1 が ) 0.Let 


W = fg  V : g(7o) = 0 for eachk = 0,.…,77 一 


Then W is a subspace of that is invariant under (the invariance holds because 
fo MW then の (7*(7o) ) ニー 0 for た = 0,.……, 娘 一 1, where the case た ニカ ー1 
holds because 7" = 0). We will show that ソ = リリ Ue@ W, which by the previous 
paragraph will complete the proof. 
To show that U+ W is adirect sum, suppose の げ nWwitho 了 0. Because 
っ , there exist co, …, CEF such that 
の? 三 cog 寺 7 ルオ … オ ロー177ー177. 


Let7 be the smallest index such that チ 0.Apply 7ーー1 to both sides of the 
equation above, getting 
MM 


where we have used the equation T" = 0. Now apply w to both sides of the 
equation above, getting 


@ ゅ (7 アー?) = gg(7 ゲ "ーー の チ 0. 


The equation above shows thato W. Hence we have provedthatUnW =({0}, 
which implies that + W is a direct sum (see 1.46). 
To show thatU@W=V,defne5: ソ ソーEPby 


So = (の, の,…。 の (7"ー1) ). 
Thus null 5 = W. Hence 
dim W = dimnullS = dim ソ ーdimrangeS > dim ソ リー カ , 


where the second equality comes from the fundamental theorem of linear maps 
(3.21). Using the inequality above, we have 


dim(U @ W) = dim+dimW ツ > 娘 二 (dim ツ ソー カ ) = dim ソ . 
Thus U @ W = ニレ (by 2.39), completing the proof. 
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Now the generalized eigenspace de- Cp 7o7gz (7838-7922) px の - 
composition allows us to extendthepre- ZZ proor の 8.46 7820. 


vious result to operators that may not be 
nilpotent. Doing this requires that we deal with complex Vector SDaceS. 


Proof Let A」,.…, ん be the distinct eigenvalues of 了 . The generalized eigenspace 
decomposition states that 


=G(A1,7) @… @ GA 7), 


where each ザー ルル に 7) 1S milpotent (see 8.22). Thus 8.45 implies that some 
basis of each G( 和 A, 了 ) is a Jordan basis for アー ルル) 7 の. Put these bases 
together to get a basis of V that is a Jordan basis for 7 


re7czyey @C 


1 Suppose 7 々 ( 〇 ?) is the operator defined by 了 (z],2 の 25) 三 (2 っ ,Z3, 0). 
Prove that 7 does not have a square root. 


2 Deine 7 と /(E?) by ア (X」, 5, テ 3, 4。 5) 三 (2 ァ , 3 一 4, 45, 0). 


(a) Show that ア is nilpotent. 
(b) Hind a square root of J+ 本 


3 Suppose V is a complex vector space. Prove that every invertble operator 
on has a cube root. 


4 Suppose V is a real vector space. Prove that the operator -Jon hasa 
sduare root 古 and only 半 dim is an even number. 


S Suppose 7 々 (C) is the operator defined by 了 ( の ,z) = (- の 一 Z,9z の + 5Z). 
Find a Jordan basis for 刀 


6 Hinda basis of の ,(R ) that is a Jordan basis for the differentiation operator 
り on の ,(R) defned by D ヵ = 


7 Suppose 7 々 () is milpotent and の 」, …, の , 1S a Jordan basis for 7. Prove 
that the minimal polynomial of ア is 27+1、 where 7 is the length of the 
longest consecutive string of 1's that appears on the line directly above the 


diagonal in the matrix of 7 with respect to の 」, .…, の ,. 


S Suppose 7 と ズ () and ?o」,…, の , 1S a basis of that is a Jordan basis for 
Describe the matrix of 72 with respect to this basis. 


Section 8C Consequences of Generalized Eigenspace Decomposition 325 


9 


10 


11 


12 


13 


14 


Suppose 7 と 々 () is nilpotent. Explain why there exist の 」,…。 の 6, と and 
nonnegative integers 77, ……, 77。 SUch that (a) and (b) below both hold. 
ーッ イナ の の ーッ ナリ 7 の の の 。 1S a basis Of . 

(b) な 22 ーー MAC ー0. 


Suppose 7 (げじ ) and の 」,… の, 1S a basis of that is a Jordan basis for 7 
Describe the matrix of 了 with respect to the basis ?,,…, の 」oObtained by 
reversing the order of the の s. 


Suppose 了 々 ( じ ). Bxplain why every vector in each Jordan basis for 了 is 
a generalized eigenvector of 了 ア , 


Suppose 7 と 々 ( ゆ ) is diagonalizable. Show that 7 7) is a diagonal matrix 
with respect to every Jordan basis for 7 


Suppose 了 々 (V) is milpotent. Prove that if の 」,…, の, are Vectors in and 
7 …。 77。8Te nonnegatiVe integers such that 


7 の] の 1 の ーッ ナリ 2 の …。 ナ の の, 1S a basis Of レ 


and 
9 Ye Ma = 0, 


then 778 の …… 7 の, 1S a basis of null 子 
777s ee7cZe SO が 27 7 ーー dimnull 7 775 7 が e の 5777ve 777768e7 77 777g7 
@/ の 6 の 7y @ の ove の e/e72 の 5 O7/ の の 7 7 7 の 7 の 7 7 ee spec777c /O7 の 27 の 579 
cose7 /27 ア 


SupposeF = Cand 了 と イズ (). Prove that there does not exist a direct sum 
decomposition of V into two nonzero subspaces invariant under 7 症 and 
only if the minimal polynomial of is of the form (一 APY for some 
AEC. 
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@ の 772ce: 人 A Co777ec77o77 Pe7ee77 ル 72777Cey 7 の 〇 の e77 の 7 ゞ 


We begin this section by defining the trace of a square matrix. After developing 
some properties of the trace of a sduare matrix, we will use this concept to defime 
the trace of an operator. 


Suppose 4 is a square matrix with entries in F. The 7gce of 4, denoted by 
r 4, is defined to be the sum of the diagonal entries of 4. 


8.48 example: 77ce の げ g 3- の y-3 7 の が 7 


SuDDOSe 


3 一 1 =2 
導 三 1 83 計 =8 | ト 
1 2 0 


The diagonal entries of 4, which are shown in red above, are 3, 2, and 0. Thus 
fr 人 4 ニー3+2+0=5. 


Matrix multiplication is not commutative, but the next result shows that the 
order of matrix multiplication does not matter to the trace. 


8.49 77gce の 7 4P egg/5 7gce の 7 ん 


Suppose 4 is an 77-by-77 matrix and is an 7-by-77 matrix. Then 


tr(4p) = tr(P4). 


Proof Suppose 
20n "や" 0 8 … 用 記 
4 = 5 : > ぢ = : 

4 4 Bi」 … p 


7。1 77。77 万 。777 


The 過 term on the diagonal of the 77-by-7 matrix AB equals ツー」 4 Thus 


トイ 


tr(45) = 
7 


4 


[ ト 全 lb2E 


l 

由 

l 

MA 

の 

9 
、 よ 
問 


( 記 term on diagonal of the 7-by-7 matrix 4) 


昌 
トイ > 


三 tr(P4), 


as desired. 


Section 8D Trace: A Connection Between Matrices and Operators 327 


We want to define the trace of an operator 7 々 ( じ ) to be the trace of the 
matrix of with respect to some basis of However, this definition should not 
depend on the choice of basis. The following result will make this possible. 


8.50 77ce の 7 772777 の 7 O/677 の 7 の 26 72O7 の 6 の @72 O77 の 579 


Suppose 7 々 ( じ ). Suppose 7 .…, 4 nd の …… の are bases of じ Then 


2 人 Ws の) 用 (27(0 (2 の 6) 


Proof Let 4 = 77(7, (4 )) and p ニ 77(7, (の, … 6) ). The change-of- 
basis formula tells us that there exists an invertible 7-by-7 matrix C such that 
4 ニーC-TBC (see 3.84). Thus 


fr4 = 価 ((G BC] 
時 (en5) | 
= r( (CC~ り 8) 


ニ (fr, 


where the second line comes from 8.49. 


Because of 8.50, the following definition now makes sense. 


_8.51 definitlion: ce の 7 77 の の 677 の 7 


Suppose 7 々 ( ゆ ). The 7gce of 了 , denote r 了 , is defined by 
tk 親族 三 (00(UN( の 50 


where o」,…, の, 1S any basis of 


Suppose 7 と 々 () and is an eigenvalue of 了 . Recall that we defined the 
multiplicity of ル to be the dimension of the generalized eigenspace G( ん , 了 ) (see 
8.23): we proved that this multiplicity equals dim nul1(7 ー 47)9mY (see 8.20). 
Recall also that ザ is a complex vector space, then the sum of the multiplicities 
of all eigenvalues of ア equals dim V (see 8.25). 

In the definition below, the sum of the eigenvalues “with each eisenvalue 
included as many tmes as its multiplicity” means that iA」, .…, ん 。 are the distinct 
eigenvalues of 了 with multiplicities g」, .… の then the sum is 


9 キー* 十 の ルル. 


Or if you prefer to work with a list of not-necessarily-distinct eigenvalues, with 
each eigenvalue included as many tmes as its multiplicity, then the eigenvalues 
could be denoted by A」,.…, 和 ん, (where 7 equals dim ぴ ) and the sum is 


ル 4」 キ …ー オ エル. 
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8.52  o7 co77 の /er vec7O7 5 の Cey, 7 の Ce 697/9 ゞ 77777 O/ @7ge77D/776 ゞ 


SupposeF = Cand7 ア と ん 々 ( ゆ ). Then rr equals the sum of the eigenvalues 
of 李 7, with each eigenvalue included as many tmes as its multiplicity. 


Proof There is a basis of V with respect to which 7 has an upper-triangular 
matrix with the diagonal entries of the matrix consisting of the eisenvalues of 子 , 
with each eigenvalue included as many times as its multplicity 一 see 8.37. Thus 
the definition of the trace of an operator along with 8.50, which allows us to use a 
basis of our choice, implies that 7 equals the sum of the eisenvalues of 了 了 , with 
each eigenvalue included as many times as its multiplicity. 


8.53 example: 7ce の 7 の 2 Ope7g7 の 7 o77 C? 


Suppose 7 了 と (で?) is defined by 
了 (Z],2, Z。 ) ヒー (3z」 呈 2 っ 一 22。, 3Z」 下 22。 っ 昌 3Z3,Z] 寺 22。) . 


Then the matrix of7 with respect to the standard basis of で ? is 


3 一 1 2 
3 2 -3 |. 
1 2 0 


Adding up the diagonal entries of this matrix, we seethatr ア = ニ 5. 

The eigenvalues of ア are 1.2+37, and2 一 37, each with multiplicity 1, as 
you can verify. The sum of these eigenvalues, each included as many times as its 
multiplicity, is 1 + (2+3) + (2 3 の , which equals 5, as expected by 8.52. 


The trace has a close connection with the characteristic polynomial. Suppose 
F =C,7 と の ( ゆ ), and A」, .…, ん , are the eigenvalues of 了 , with each eigenvalue 
included as many tmes as its multiplicity. Then by definition (see 8.26), the 
characteristic polynomial of 7 equals 


(一 4A1)…(z 一 ん ). 


Expanding the polynomial above, we can write the characteristic polynomial of 
in the form 


ダー( 和 キー キル 527ー ト キキ … キ (ー-1)7(4…。). 


The expression above immediately leads to the next result. Also see 9.63, 
which does not require the hypothesis thatF =C. 


8.54 77ce 777 C777 の 7677577C の 77O77770/ 


SupposeF = Cand7ー ズ ( ゆ ). Let ヵ 7 = dimV Then fr ア 7 equals the negative 


7 一 1 


of the coefcient of z"~) in the characteristic polynomial of ア 
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The next result gives a nice formula for the trace of an operator on an inner 
product sDace. 


8.55 777Ce の 72 の 77 7777767 7 の 77C7 5 の の C6 


Suppose V is an inner product space, 7 々 ( り ), and e」, .…,6, 1S an orthonor- 


mal basis of Then 


7 サテ (7e1,e) キー… ナ (人 76)- 


Proof The desired formula follows from the observation that the entry in row ん 
column た of (7 (6」,…)g)) eduals (Te gr) [use 6.30(a) witho = 7eu]. 


The alsebraic properties of the trace as defined on square matrices translate 
to algebraic properties of the trace as defined on operators, as shown in the next 
result. 


8.56 7ce 777e7 


The function tr: 々 () 一 FE is a linear functional on 々 ( ぴ ) such that 


tr(5 ず ア ) = tr(75) 


for all 5.7 と (の). 


Proof Choose a basis of All matrices of operators in this proof will be with 
respect to that basis. Suppose 5,7 と て ( ぴ ). 
えと FE,then 


tr(A7) = rf(47) = tr(A77⑦)) = Atr 777) = Ar アア 


where the frst and last equalities come from the definition of the trace of an 
operator, the second equality comes from 3.38, and the third equality follows 
from the definition of the trace of a square matrix. 

Also, 


tr(5+ ア ) = rr 77(5+ 了 ア ) = tr(77(5)+ 77(7) ) = tr 77(5) + tr 2777) = tr5+tr 了 ア , 


where the frst and last equalities come from the definition of the trace of an 
operator, the second equality comes from 3.35, and the third equality follows 
from the definition of the trace of a square matrix. The two paragraphs above 
show that tr: /(Y) 一 F is alinear functional on 々 (ぴの ). 

Furthermore, 


tr(57)=r77(S7) =tr(27(5)27(7)) = tr(27(7)27(5)) =r 77(79) = r(7S), 
where the second and fourth equalities come from 3.43 and the crucial third 


equality comes from 8.49. 


The equations tr(5 ず ) = tr(7S) and tr7 = dim ザ uniquely characterize the 
trace among the Hinear functionals on 々 ( り ) 一 see Exercise 10. 
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The equation tr(57) = tr(7S) leads 
to our next result, which does not hold on 
infimite-dimensional Vector spaces (See 
Exercise 13). However, additional hy- 
potheses on 5, 了 , and lead to an infinite- 
dimensional generalization of the result 
below, with important applications to 
quantum theory. 


777e s7767776727 の 7777e 7er7 76y7/7 oey 
7 の 7 772DO/ue 777Ces, の 77 777e y77O77 /7 の o/ 
ey 7 の Cey. Me7z sO7776777777g /7e 777y 
4 の Pe72 ゞ 777 7 の 777e77777Cy 777e72 457477/y 
@ 8 の 9 ge/7777 の 7 77y 77 太 e の gc た - 
g7 の 7777. 


Proof Suppose $5,7 と ん ( ゆ ). Then 
tr(5 ア ー7 了 5S) = tr(57) - tr(75) = 0, 


where both equalities come from 8.36. The trace of equals dm which is not 0. 
Because 5 アー 了 5S and 了 have different traces, they cannot be equal. 


re7czyey 6 


1 Suppose V is an inner product space and?, の ヒザ Defme an operator 
了 ー イ () by 7 = (の の) の. Find a formula for rr 了 ア 


2 Suppose ア と の ( じ ) satisfies P2 = P Prove that 


r ア = dimrange 用 


3 Suppose ア 7 々 (Y) and7? = アア Prove that the real and imaginary parts of 


tr7 are both integers. 


4 Suppose is an inner product space and 7 と 々 (). Prove that 
tr7*ーfr 了 . 


S Suppose V is an inner product space. Suppose 7 ヒ 々 (V) is a positive 
operator andr ア ニー0.Provethat ア =0. 


6 Suppose V is an inner product space and 選 O と 々 ( ツ ) are orthogonal 


projections. Prove that tr(PO) > 0. 


7 Suppose7 と 々 (で?) is the operator whose matrix is 


51 一 12 
60 -40 
57 一 68 


ー21 
ー28 |. 
1 


Someone tells you (accurately ) that 一 48 and 24 are eiegenvalues of ア . Without 
using a computer or writing anything down, find the third eigenvalue of 了 ア 
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S Prove or give a counterexample: If 5,7 と 々 ( ゆ ), then tr(57) = (rS)(r ア ). 


9 Suppose 7 6 々 () is such that tr(5 ず 7) = 0 for all 5 と 々 (の ). Prove that 
了 アー ニー0. 


10 Prove that the trace is the only linear functional て: 々 () つ E such that 
ィ (5 了 ず ア ) ニ ィ (75) 


for all 5,7 と 々 () and 7⑦ = dim 
万 5 の Pose 7g7 の ]… の, 7 が 5 9 の gy7y の 7 7o7 記 た 人 1,… 妃 , de 万 7e 
ょ る ( ゆ ) の (の の キー の の) 三好 の. 7ove 放 g7 
1 ガ = た 
0 妨 チ た 
77ez 7 7 と イ ゆ ), xse 万 e egg が o7 7 ニー クルー ュ 2 277) Pr 7 の 
sow 万 g7 て 7) = r ア 


0 すう) 三 | 


11 Suppose and W are inner product spaces and7 と バ ( WV). Prove that if 
6,… っ 6 1S an Orthonormal basis of and 方 ,…, 刻 , 1S an orthonormal basis 
of WW, then 


WW と か 26 が 
た =17=1 


77e 7 の ery (7er。 元 g7e 77e e7777ey の 7 77e 7 の 7 の 了 7 7e5Dec7 7 の 77e 
の 777,o7o777297 gyey e」」 …, 6 7 の 刻 ,…。 77ese 77472 の e7y epe77 7 77e 
pgses, の 7 人 T(7 パ ア ) oes 7o7 の epe77 o7 6 CO7ce の 7 の gsey. 777745 7775 ere7c7Se 
sos 刀 7 娘 e sz777 の 7 万 e 974d76y の / 娘 e の yo/z7e ves の げ 7 7e 7 の が 677776 ゞ 
goey 7 の 7 の e/e7 O77 77C7 の 777 の 7 の 777277 の yes の 76 7456 の . 


12 Suppose and W are fimite-dimensional inner product sDaces. 


(&) Prove that (5, 了 ) = rr(7“S) defines an inner product on ( W). 

(b) Suppose 6, …,6, 1S an orthonormal basis of and 方 ,…, 1S an or- 
thonormal basis of W. Show that the inner product on 々 (VMW) from 
(a) is the same as the standard inner product on Fwhere we identify 
each element of 々 (V W) with its matrix (with respect to the bases just 
mentioned) and then with an element of FE"7 


Cgz77o7・ 77e 777 の 7 777eg7 77 の の 7 ん (W) gs ee の の 7.66 5 7 の 7 
77e sg7776 5 77e 77O7777 777 CO7776 ゞ 廊 777 77e 777767 7 の 97C7 77 (の ) の ove. 07/eyy 
er//7c777y 77eg o777e7y7ye, の 7 の yy の 24726 77 7 7e6/e7y 7O 777e 7 の 7777 の 9 
ge/eg の の /.66. 77e 7o7772 娘 27 Co7776S 万 o77 娘 e 7777767 7 の zz7 77 () 75 cg77e の 
娘 e 7o/e7775 7207777 O7 777e 万 7 の e77-Sc7z7277 7707777. 


13 Find 5.7 と の (アア (F) ) such that 57ー75 = 了 7 


万 7777- 472e 72 の の /7O/77776 72077 が Cg77O7 の 7 が e の Pe7 の 7 の 7* 77 研 YG77 の 7e う .9. 


777y ere7c7se sowy 777 の 77727 の 7 の 777eses 97e 76eeg o7 S 7 了 7 の 
eX/e7 8.5/ 7 の 77e ye777775 の 7 7772776- の 7777672S7O7297 VeC7O7 5 の DC@S. 


| 
Chapter 9 匠 hd 
ル 7777777777eg7 人 4/pe の 7 777 の e7c77777747775 


We begin this chapter by investigating bilinear forms and quadratic forms on a 
Vector space. Then we will move on to multilinear forms. We will show that the 
Vector space of alternating 7-Hinear forms has dimension one on a vector space of 
dimension 7. This result will allow us to give a clean basis-free definition of the 
determinant of an operator. 

This approach to the determinant via alternating multilinear forms leads to 
straightforward proofs of key properties of determinants. For example, we will see 
that the determinant is multplicative, meaning that det(S57) = (det5)(det 了 ア ) for 
all operators S and ア on the same vector space. We will also see that is invertible 
if and only if det ア チ 0. Another important result states that the determinant of 
an operator on a complex vector space equals the product of the eigenvalues of 
the operator, with each eigenvalue included as many tmes as its multiplicity. 

The chapter concludes with an introduction to tensor products. 


es Edenotes R or C. 
e ソレ and W denote finite-dimensional nonzero Vector SDaces Over F. 


VS OO JOJ19d A9UHBI 


77e 7277e7777cg/ 77257777e 7 77e 7e7577 の OO7777ge77. 7775 の 7777g の pe7e の 77 7 の 30, 
We7z 太 77 の y Woe7e7 (7682-7 の 35) 2 277eg の y の ee77 7 76ye7C77 774777e777777C777 74 の 
放 cz/ が 77e77 の e7 g7 77e 7777Pe757 が の 7 の 7 75 yeg7y ( 太 e 万 7 e7g777 Yeg7 77 の 77 77 の) 
/oe77e7 gy 7e の か y 万 e /Wg<7 gove7777776777 77 7 の 33. 77e77 /VOe77e7 74 77e7 
co7/74 の o777O7y 7 c7eg76 777g77y の 7e /27777277O74y の 7 7 の e777 7ge の 7 の , 72C774 の 7729 の 72 
g の 577@C7 7ge の 7 7 の の 777 7 CO777 の 7ed 7 77e の eve/O/7776777 の / 7776g7 7ge の 7 の . 
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94 7/7777e7 7O77779 777 び 727777C の 7777 ゞ 


77777ed7 7O7777 ゞ 


A bilinear form on is a function from "xtoEF that is Hinear in each slot 
separately, meaning that if we hold either slot fixed then we have a Hnear function 
in the other slot. Here is the formal definiton. 


9.1 definition: 7/777e7 /2777 


A zeg7 72777 on V is afunction お : ソ x レ ソーFsuch that 


の (の 2) and の 中 が (4 の 


are both Hnear functionals on for every 7 と 


For example, if is a real inner prod- 
uct Space, then the function that takes an 7 訪 如 e de7777o7 の ove, 77eg7y 
ordered pair (4 の ) 三 VxVto(〈⑫. の )15  。 大 eg7 7zc77O7 7 77PS 777 の 77e 
a bilinear formonV ITVisanonzero scg// 7e/7 F. 7774y 77e 7e7777 77777267 
complex inner product space, then thiS  /zczozg/ oz/ の e 777O7e CO725757e777 
function is not a bilhinear form because 7e7zo/ogy 万 7 777zeg7 /o77, 7c7 
the inner product is not Hinear in the sec- 72g7e/y gy の eco7ze 7d72 の g77. 
ond slot (complex scalars come out of the 
second slot as their complex conjugates). 

IfE = KR, then a bilinear form differs from an inner product in that an inner 
product requires symmetry [meaning that (2, の ) = (の , の ) for all oo とり | 
and positive definiteness [meaning that (の ,o) > 0for allo と \(0} |, but these 
properties are not reduired for a bilinear form. 


9.2 example: /777zeg7 め 7775 


e Thefunction 8: FEFxE っ Fdefined by 


ecg7/ 7747 娘 e 7e7772 /7267 /7472C7 が の 72 ん) 


P((1, 5, 3), (2, 5) ) 三 17> 一 5 2Ya 
is a bilinear form on FE". 


* SupPose 4 is an 7-by-7 matrix with 4 Finrow 7, colnmn. Detme a 
bilinear form 。 onF" by 


MNO 00 ラ ニル か 00 
た =17=1 


The first bullet point is a special case of this bullet point with ヵ =3and 


0 1 0 
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e Suppose is a real inner product space and 7 ( ゆ ). Then the function 
p: ソ x ソ っ Rdefned by 


(2, の ) ニ (5 子 の ) 
is a bilinear form on 
e Tf7isa positive integer, then the function j: の (R) x の ,(R) っ R defmed by 
の, の ) = 2) 7 (③) 
is a bilinear form on の ,(R). 
e Suppose の , て  V. Then the function お : ソ x ソ ーFdefmed by 
P( ヵ の ) = の (の ・ て (の ⑦) 
is a bilinear form on 


es More generally。 suppose that の 」,…, の て … て ビ (Then the function 
p: ソ x ソ っ defined by 


(4 ぬ の ) 三 の 1()・ イ (の ) キー の (2)・ て (9) 
is a bilinear form on 尼 


A bilinear form on is a function from ソ x to F. Because ソ x リ is aa Vector 
Space, this raises the question of whether a bilinear form can also be a hnear map 
from ソ xVto F. Note that none of the bilinear forms in 9.2 are linear maps except 
in some special cases in which the bilinear form is the zero map. Exercise 3 shows 
that a bilinear form pon VisalHnear map on ソリ x ソ only ぜ pg=0. 


The set of bilinear forms on V is denoted by "② 


With the usual operations of addition and scalar multiplication of functions, 
V(② is a vector space. 

For 7 an operator on an 7-dimensional vector space V and a basis e], … 6 
of V we used an 77-by-7 matrix to provide information about 7. We now do the 
same thing for bilinear forms on 


Suppose p is a bilinear form on and ei, …,e, is a basis of The 7 が 7 of 
P with respect to this basis is the 7-by-7 matrix (の) Whose entry 7()」 
in row 7 column is given by 


7(8), ょ 三 (2 @). 


Tf the basis ge」,.……,e, 1S not clear from the context,then the notation 
200(B 06 ee)UUS MoE 
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Recall that F”" denotes the vector space of 7-by-7 matrices with entries in F 
and that dimF7 ケ ー カ < (see 3.39 and 3.40). 


9.5 dimV② = (dim)< 


SuDDOse e」, ……,6, 1S a basis of / Then the map p 中 77(6) 1S an isomorphism 
of V(② onto F ケ 7 Furthermore, dim V② = (dim P)< 


Proof The map 77( の ) is clearly a inear map of リヴ ⑦ into F7 
For 4 と F の 7 define a bilinear form ponVby 


7 77 
CZ66321 キー 7 の 1 キー… 十 妨 虫 ) 当 2 ん 
ニ 1 7 = 
or イッ リー の ビ F (GTf ソ ニーF"ande」,.…,e, 1S the standard basis ofF'? this 
4 is the same as the bilinear form / 。 in the second bullet point of Example 9.2 ). 
The linear map 77(6) from V⑦ to FE の 7 and the inear map 4 ら B。 from 
Fr7 to リツ are inverses of each other because yr) forall の モ リウ and 
77(64) =4foral4 Fas you should verify. 
Thus both maps are isomorphisms and the two spaces that they connect have 
the same dimension. Hence dim V(② = dimF の ケニー ニ ィ カー (dim ぴ )^. 


Recall that C' denotes the transpose of a matrix C. The matrix C' is obtained 
by interchansing the rows and the columns of C. 


9.6 co7O5777O77 07 @ 77/777e7 / の 7777 777 7 67 の 7 の 7 


Suppose p is a bilinear form on and 7 ん ( ゆ ). Defime bilinear forms 
and/on ソ by 


w(74, の ) 三 (7 の ) and p(4. の ) = p(74. の ). 


Let e」, …,e, be a basis of Then 


27(@) = 27(8)27(T) and 27( の ) = 27(⑦)'7(@). 


Proof Hf た 人 1 …,7), then 
7 (@), 4(@,@) 
= P(@, 了 ge) 


= 27 の re) 
777 三 1 


4( ら ぁ 0630 


77 三 1 


(27(⑧)27⑦⑰)) 。 


Thus 7(z) = 77().77⑦). The proof that 77(p) = 27(7)*77(6) is similar. 
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The result below shows how the matrix of a bilinear form changes if we change 
the basis. The formula in the result below should be compared to the change- 
of-basis formula for the matrix of an operator (see 3.84). The two formulas are 
similar, except that the transpose C' appears in the formula below and the inverse 
C~ appears in the change-of-basis formula for the matrix of an operator. 


9.7 cg7ge-o た の gs75 /277777772 


Suppose p と V② Suppose e,.…, 6 and 片 ,…, 刻 are bases of Let 


2M 志 702 有 (2 5 2 iC 呈 恨 702 (0 ーー 
andC= 77( 是 ,… っ 6),( 旋 , …, 訪 )). Then 
ノニ CC. 


Proof The Hinear map lemma (3.4) tells us that there exists an operator 7 と 々 () 
such that 了 ん = erfor each た = 1,.…,7. The definition of the matrix of an operator 
with respect to a basis implies that 


7 (7, (方 ,…, 訪 )) = C. 
Defime bilhinear forms ヶ ,/ on by 
w(7, の ) 三 p( 7 の ) and p(4 の ) = (7 の) = PT 7 の ). 
Then P(@,@) ニー pg7 ル 7 ん ) ー の 3) for all た で 人 1, …,7). Thus 


基 呈 000. (用 ああ ) 
= C'27(a, 訪 ,…。 刻 )) 
= Ci5C. 


where the second and third lines each follow from 9.6. 


9.8 example: 77e 7 の og 77777eg7 727777 の 7 5(R) 


Defime a biiinear form ) on め (R) by 8⑦,7) = (2)・7 (3). Let 
4 = 7(8,(1 ァ テー2, (テー3) 人 ②) and B=27(8,(1, ァ 7)) 
andC = 7( 李 (1 ァ ー2,( ァ テー3)②), (1,z,*②)) . Then 


0 1 0 0 1 6 1 -2 9 
用 | 0 0 0 and ぢ =| 0 2 12 and C=| 0 1 -6 1. 
0 1 0 0 4 24 0 0 1 


Now the change-of-basis formula 9.7 asserts that 4 = C'BC, which you can verify 
with matrix multiplication using the matrices aboVe. 
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Sy7777776777C 77777eg7 7O77775 


A bilinear form p と の ② is called syy7ze77c 下 


の (7 の ) 三 (の 7) 


for all の と The set of symmetric bilinear forms on Vis denoted by 0 


9.10 example: yy7777677C の 7777e7 / の 77775 


e IfVisareal inner product space andp リヴ の is defined by 
の (4. の ) 三 (7 の ), 
then p is a symmetric bilinear form on 
e Suppose Vis a real inner product space and7 と ( ゆ ). Defnep と り ② by 
(4, の ) 三 (4 了 ナ 7 の ). 


Then p is a symmetric bilhinear form on り and only エア is a self-adjoint 
operator (the previous bullet point is the special case ア = リカ . 


e Suppose p: 々 (Y) x 々 ( ゆ ) っ F is defned by 
p(5, 了 ) = (57). 


Then pis a symmetric bilinear form on 々 () because trace is a Hinear functional 
on 々 () and tr(57) = tr(75) for all 5.7 々 ( じ ): see 8.36. 


A square matrix 4 is called sy7z7ze777c if it eduals its transpOse. 


An operator on may have a symmetric matrix withrespect to some but not al 
bases of V In contrast, the next result shows that a bilinear form on has a sym- 
metric matrix with respect to either all bases of V or with respect to no bases of 


9.12 sy77777677c /7/777eg7 / の 77775 の 76 726 の 7 の 77<g// 


Suppose p と リ ② Then the following are equivalent. 
(&) pis a symmetric bilinear form on 


(b) 7(p, (e],…,,) ) 1S a symmetric matrix for every basis e, …,6, Of / 


(c) 7(p, (e], …, 6。) ) 1 a symmetric matrix for some basis e], …,e, Of 


7(p, (e」,…,,) ) is a diagonal matrix for some basis e」,…,e, Of / 


338 Chapter 9 Multilinear Algebra and Determinants 


Proof Hirst suppose (a) holds, so p is a symmetric bilinear form. Suppose 
6 … っ 6 1S a basis of Vand 廊 た 三代, …, 7 Then の (@, 換 ) 三 の (6 らら) because p 
is symmetric. Thus 77(p, (e,…,6,) ) 1S a symmetric matrix, showing that (a) 
implies (b). 

Clearly (b) implies (c). 

Now suppose (c) holds and e」, …,e, 1s a basis of such that 27 (p, (e],…, 6。) ) 
is a symmetric matrix. Suppose 4, の There exist 2 のり の] 所 
such that 7 三 216」 キオ … 二 6 amd の ニー5e」 す …+ ち e. Now 


(の ) =( 2 9 の 2 ee) 
了 テ 1 記 沖 


7 


2 MS の オリ (プン 


7 7 


に 2 0 の 7, (6 の ) 


#1 旬 三 1 
=p( > es 2 9 の) 
た =1 7 ニ 1 
三 /(⑦, の)。 


where the third line holds because 7(p) is a symmetric matrix. The equation 
above shows that / is a symmetric bilinear form, proving that (c) impHes (8). 

At this point, we have proved that (8), (b), (c) are equivalent. Because every 
diagonal matrix is symmetric, (d) implies (c). 1o complete the proof, we will 
show that (a) implies (d) by induction on7 = dimV 

T ヵ = 1, then (a) implies (d) because every 1-by-1 matrix is diagonal. Now 
suppose 7 > 1 and the implication (a) = (⑨) holds for one less dimension. 
Suppose (a) holds, so / is a symmetric bilinear form. Tp =0, then the matrix of 
p with respect to every basis of V is the zero matrix, which is a diagonal matrix. 
Hence we can assume that / チチ 0, which means there exist 7。 の ヒビ リ such that 
p( ヵ 2 の) チ 0.Now 


2p(7, の ) 三 D(7 十 の ,7 十 の) 一 /(, 7) 一 p( の , の ) . 


Because the left side of the equation above is nonZero, the three terms on the right 
cannot all equal 0. Hence there exists o Vsuch that p(⑦ の) 0. 

Let リ =(z ツ リザ: p(, の ) =0). Thus U is the null space of the Hinear 
functional z ら p( 計 の) on This Hinear functional is notthe Zero linear functional 
becauseo /. Thus dim = テニ ァ ー1. By our induction hypothesis, there is a 
basis e],…) 6 - ュ Of / such that the symmetric bilinear form /l, has a diagonal 
matrix with respect to this basis. 

Becauseo U,the Hste],…, 6 の 1sa basis of/ Suppose 代 ,…,7ー1). 
Then pe の) = 0 by the 00NPHGO of . Because p is STAGSN we also 
have /( の , er) = 0. Thus the matrix of / with respect to e],…, 6 の 1S a diagonal 
matrix, completine the proof that (a) implies (d). 
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The previous result states that every symmetric bilinear form has a diagonal 
matrix with respect to some basis. If our vector space happens to be a real inner 
product space, then the next result shows that every symmetric bilinear form has 
a diagonal matrix with respect to some o777o7o7777 basis. Note that the inner 
product here is unrelated to the bilinear form. 


9.13 ggo7d/7<77O77 の 7 5y7777776777C /7/777eg7 /27772 の 72 の 7777O77O777297 の 975 


Suppose V is a real inner product space and / is a symmetric bilinear form on 
V Then 。 has a diagonal matrix with respect to some orthonormal basis of 


Proof Let 方 ,…, 訪 be an orthonormal basis of V Let = 7(p,( 方 ,…, 刻 )). 
Then ぢ is a symmetric matrix (by 9.12). Let ア 々 ( じ ) be the operator such that 
27 (7, (方,…, 記 )) = P. Thus 7 jis self-adjoint. 

The real spectral theorem (7.29) states that 了 has a diagonal matrix with respect 
to some orthonormal basis e」,…,e, Of LetC= 7(7 (6」,…) (方 ,…, 訪 )). 
Thus CT7C is the matrix of with respect to the basis e」, .…,e, (by 3.84). Hence 
C- ザ 7C is a diagonal matrix. Now 


MK 呈 66 て 6 


where the frst equality holds by 9.7 and the second equality holds because C is a 
unitary matrix With real entrics (which implies that C~~ = C:: see 7.57). 


Now we turn our attention to alternating biHinear forms. Alternatingmultilinear 
forms will play a major role in our approach to determinants later in this chapter. 


9.14 definition: 4/7e7777776 77777eg7 7 の 7772. 6 
A bilinear form z と リ ⑦ is called 2/7e77zg777g if 


(の の ) 三 0 


forallo と V じ V The set of alternating bilinear forms on Vis denoted by AA 6 


9.15 example: g77e77727774g の 77777eg7 277775 


e SuDDose れ 73andwiEPxEF っ Eisdefmed by 


MC っ (の っ の )) 1 一 ち 填 *193 一 31・ 
Then z is an alternating bilHinear form on F* 
e Suppose の , て ソ : Then the bilinear formw on Vdefned by 
(474。 の ) 三 の (7⑦) て (の ⑦) 一 の (の ⑦) て (2) 


is alternating. 
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The nextresult shows that a bihnear form is alternating if and only if switching 
the order of the two inputs multiplies the output by 一 1. 


9.16 c/47c7e77<77O77 の / 977e77777729 の 7/777eg7 /277779 


A bilinear form z on is alternating if and only 下 


(7, の) 三 一 ルル (⑦, 7) 


for al 7 の と 


Proof Hirst suppose that z is alternating. If zo then 
0 = ニ w(7 み 7 十 の,7 十 の) 
三 W(7, 7) 十 (7。 の) 十 (の 。7) 十 (の ⑦, の ) 


三 W(7, の ) 十 (の , 77). 


Thus (が, の) 一 (< の, 7), aS desired. 
To prove the implication in the other direction, Suppose (4, の) 三 一 (の 。 7) 
for allz, み の と Then gw(o, の ) = ーw(?, の ) for allo と V which implies that 


w( の , の ) = 0for allo と V Thus z is alternating. 


Now we show that the Vector space of bilhinear forms on Vis the direct sum of 
the symmetric bilinear forms on り and the alternating bihnear forms on / 


9 の Ye 


The sets MM and 5 are subspaces of ②⑦. Furthermore。 


EAATA 


alt 


Proof The definition of symmetric bilinear form implies that the sum of any two 
symmetric bilinear forms on Vis a bilinear form on and any scalar multiple of 
any bilinear form on is a bilinear form on Thus AS is a subspace of リ (②. 
Similarly, the verification that 4 is a subspace of V② is straightforward. 

Next。 we want to show that の ⑦ ニ リ 計 + リ の . To do this, suppose と リヴ) 
Define p,w と V② by 


BAY 0 ーー and w(7。 の ) 三 0 00 の 


Then p と 24 andw と や andB ニ p+ w. Thus V② = MA + V の . 
Finally, to show that the intersection of the two subspaces under consideration 


eduals {0}, suppose p MAN n MA Then 9.16 implies that 

(27 の ) ニーp( の , 74) ニーp(74。 の ) 
for all z。 の と which implies that = 0. Thus V② = MSN @ 2 as implied 
by 1.46. 


の (4 の ) 
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Oz の 7777C 077779 


_9.18 definition: 2727C / の 7 の 550C77eg yy777 6 7777e47 7 7 骨 


For pabihnearform on define afunction gs: ピ ソード by (⑦) の の 
Afunctong: ソー Fis called a 2 の 77c 72777 On V there exists a bihnear 
form/onVsuchthat7 ニ 9 ぉ . 


Note that 玉 isa bilinear form,then7。 =0 下 and onlyiS alternating. 


9.19 example: 4497 の 7 が C / の 7777 


Suppose / is the bilinear form on R* defined by 


Pr,Y53), (1, 5 95) ) 三 * ュ が ュー 4 二 8Y」7s 一 3Ya7。・ 
Then 。 is the quadratic form on R? given by the formula 


8(Y, 2。 Ys) バエ ーー 4rio 十 Ss 一 3 


The quadratic form in the example above is typical of quadratic forms on F* 
as shown in the next result. 


9.20 2 の 777c 7277775 の 77 F" 


SuDDOSe 7 1S a Dositive integer and 7 is a function from F" to F. Then 
is a quadratic form onF”and only there exist numbers 4 F for 
ヵ た 6 1, .…,7}) such that 


for all (*」, .…,y。) FT 


Proof Hirst suppose 791S a quadratic form on F Thus there exists a bilinear form 
ponF" suchthat7=g。.Let 4 be the matrix of With respect to the standard 


basis of FX Then for all (y」, .…,。) と Fwe have the desired equation 
/4 7 


(イロ ーッ ) 三 B((Y]」…) イ (そっ) ) M b シッ ッッ 


た =17=1 


Conversely, suppose there exist numbers 2 ょ EFfor, た 古代 ,…,77) such that 


77 
(ティ …。 イ ) 三 4 YY 
た =17=1 


for all (*」,…)y) FT Define a bihnear form BonF”" by 
7 た 
2 し 2PE2PP 0/RUIPEPC/ 呈 b by 4 ば 
た ニ 17 ニ 1 


Then 7 = 9 ぉ , 8S desired. 
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Although quadratic forms are defined in terms of an arbitrary bilinear form, 
the equivalence of (a) and (b) in the result below shows that a yy7z7ze77c bilinear 
form can always be used. 


.21  c/727c7677<77O72 の 7 9 の 7 の 77C /277779 


Suppose9: ソ っ Fisafunction. The following are equivalent. 
(a) 91S a quadratic form. 


(b) There exists a unique symmetric bilinear form の pon ザ suchthat9 ニ 9. 


(c) (4?) = AZ( の ) forall え と Fandallo と and the function 
(4 の ) (2 二 の ) 一 %4) 一 の ) 
is a symmetric bilinear form on 


(d (2?) = 47(@) for all? と and the function 
(4 の ) は (4 十 の ) 一 (4) 一 (の ⑦) 


is a symmetric bilinear form on 


Proof Hirst suppose (a) holds, so 7 1s a quadratic form. Hence there exists a 
biiinear form such that 9 = 9。. By 9.17, there exist a symmetric bihinear form / 
on and an alternating bilinear formxonVsuchthat= ニ p+w.Now 


7 三 9 三 の: 
Hf/ 6 Mn also satisfies 7。 三 9, then 9/-。 三 0:thus ゲ ーp DA 祭 珠 


alt ? 
which implies that / = p(by 9.17). This completes the proof that (a) implies (b). 
Now suppose (b) holds, so there exists a symmetric biHinear form pon ソ such 


that7 ニ の. せん EFand? と げ then 
9(Ao) ニ p(Ao, Ao) = Ap(o, Ao) = A^p( の , の ) 三 AZ9( の ), 


showing that the frst part of (c) holds. 
Hfzo と then 


9(7 二 の) 一 (4) 一 (の) 三 (7 十 の , 7 十 の ) 一 /(7。 7) 一 (の , の ) 三 2p(7 が の ). 
Thus the function (4. の) ら (2 の) 一 (4) 一 (の ) eduals 2p, which is a symmetric 
bilinear form on completing the proof that (b) implies (c). 

Clearly (c) implies (9 す ). 
Now suppose (d) holds. Let p be the symmetric bilinear form on defned by 
9(7 填 の) 一 (7) 一 7(⑦) 
2 。 


の (4 の ) ニ 
Ifo と then 


p( の , の ) ニ 2 の 一 9 の 一 9⑦ _ 鐘 ⑦ー 人 2?) 


2 2 
Thus 7 = 9。, completmg the proof that (d) implies (8). 


(の) 
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9.22 example: sy77777677C の 7777697 7 の 7772 の 79OC776 777 の 9 の 97777C 7 の 777 


Suppose is the quadratic form on R? given by the formula 
の 1。25。%3) ニタ イー 4 Br 一 37 


A bilinear form / on RY such that 7 = ニ 9g 1S given by Example 9.19, but this 
biiinear form is not symmetric, as promised by 9.21(b). However, the bilinear 
form p on R? defined by 


の (Ya,5。 3), (9 593) ) 三 が ュー 2Xr が > 一 2 二 4 の 3 4a7 ュ ー 3X373 
is symmetric and satisfies7 ニ g。. 


The next result states that for each quadratic form we can choose a basis such 
that the quadratic form looks like a weighted sum of squares of the coordinates, 


meaning that there are no cross terms of the form yy with7 チ た 


9.23 4go7z277<g77O77 の 7 777777C / の 7777 


Suppose 7 1S a quadratic form on 


(a) There exist a basis e」, .…,6, Of and AA,…, ん, 三 F such that 


(Ye キー キ 6 ) 三 Ar イキ … 


for all y」, … テ 。  F. 


(b) IFTF =RandVis an inner product space, then the basis in (a) can be 
chosen to be an orthonormal basis of 尼 


Proof 
(a) There exists a symmetric biHinear form pon Vsuchthat9 ニ g の (by 9.21). Now 
there exists a basis e」,…,6, Of such that 77(p, (6 ,…, 6。) ) 1S a diagonal 
matrix (by 9.12). Let A, .……, 和 ん, denote the entries on the diagonal of this 
matrix. Thus 
) ル ん 放 / ニ ん 
@.。6r) 三 
の の ーー]0 放 テ を 
for all 7 た 人 1, …, 7 ィ 」,… FE, then 
9(Y161 二 3xS 十 Y ら 。) 喧 p(Y1 キー ル 16 二 … 十 Y) 
7 7 


ー か: 0 rk の (6 


た = ニ 17=1 
ニ 41* そ キー オ ルキ る 
as desired. 
(b 


ヽ ュ ン 


SupposeF = R and ソ is an inner product space. Then 9.13 tells us that the 
basis in (a) can be chosen to be an orthonormal basis of 
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re7c7yey の 4 


1 Provethatif gis a biiinear form on F, then there exists c  F such that 


PCY の ) cy 
forallx7EF. 
2 Let ヵ = dimV Suppose is a bilinear form on Prove that there exist 
の 1… ッ の っ て っ て ビリ such that 
(あの) = の 1( の ・7( の キー キオ の (の ・ て 。( の ) 


for all 6 と 
777y ere7c7Se yowy 77d7 が 7 カニ の dm ツリ 7 が e7 eve7y 77777eg7 2777 の 7 V 7y の が 


7 が e 727772 gye72 の y 娘 e /Z257 の 7477e7 po777 の 7 の /e 9.2. 


3 Suppose pj: ソ x ツ ソーFisahilinear form on and also is a Hinear functional 
onVxV Provethatp=0. 


4 Suppose is areal inner product space and pis a bilinear form on じ Show 
that there exists a unique operator 7 々 () such that 


(4 の) = ニ (, 子 の) 


for all 7,o と 攻 


777y ere7C7Se 5777ey 7777 が V 7 76g/ 777767 7 の 97/C7 5 の の C@, 777e77 6Ve7y 
77/77e7 7777 の 7 V 75 の 7 77e 7772 ge7 の 77e 77 の 77e7 po7777 7 の.2. 


S Suppose p is a bilinear form on a real inner product space and 了 is the 
unique operator on V such that (の ) ニ (7 の ) for all ヵ の リザ (See 
Exercise 4). Show that is aninnerproducton『 議 andonyif7 ア isan 
invertible positive operator on 


6 Prove or give a counterexample: If / is a symmetric bilinear form on then 
{to と V: p(⑦ の の) =0) 
is asubspace of 
7 Bxplain why the proof of 9.13 (diagonalization of a symmetric bilhinear form 


by an orthonormal basis on a real inner product space) fails the hypothesis 
thatF =Ris dropped. 


P4 


8 Find formulas for dim 94 and dim 必 で in terms of dim / 


9 Suppose that 7 is a positive inteser and ソ = 人 と の ,(R) : が (0) = p(1)). 
Definew: ソ x ソ っ ーRby 


4 


4 の =| 


Show that z is an alternating bilinear form on / 
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10 Suppose that 7 1S a positive integer and 
= 侯 と の ,(R) : が (0) =p(1) and (0) = ゲ (1)}. 
Defnep: ソリ x ソ ツーRby 


1 リ /4 
の =| 


Show that p is a symmetric bilinear form on 
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9/ 4/7e7777777g ル 774777777e7 の 77775 


77/77/7776 の 7 の 77779 


9.24 definition: リ " 


For 77 a positive integer, define V" by 


アニー ザビ x …x ザ . 
ューーーーーー 


77 Himes 


Now we can define 娘 -Hnear forms as a generalization of the bilinear forms 
that we discussed in the previous section. 


9.25 definition: 77-/7zeg7 7 2 eg7 め 777 


e For77apositive integer, an 77-/7eg7 7/2777 On V is a function B: V"ーE 
that is linear in each slot when the other slots are held fixed. This means 
that for each た {1, …,7) and all 7 ……, the function 


の 2002 導 (0 に sz 二 122 の 2 だ 1 ニン ツ の 


is a linear map from V to F. 


e The set of 77-linear forms on V is denoted by V9 


se Afunction / is called a 7 が 77777eg7 67 on fit is an 77-Hnear form on ソ 
for some positive integer 77. 


In the definition above, the expression (74,…, ルー の エー っ 7) means 
(の , 2 …。 4 下 た = 1 and means が (24],…, 2 の) 革 た ニ が . 

A 1-Hinear form on Vis a jinear functional on A 2-jnear form on js 
a bilinear form on You can verify that with the usual addition and scalar 
multiplication of functions, Vis a vector space. 


9.26 example: 77- 太 zeg7 /277775 


e Suppose w,p モツ Define a functon お : っ FEby 


(の 1, の っ の s, の 4) 三 (の 1 , の っ) (の 3, の 4)・ 
Then g とり ③ 
e Deiine 2: (/ ゆ )) っ FEby 
ae DOー(Y0)、 


Then p is an 万 -Hinear form on 々 (げじ ). 
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Alternating multlinear forms, which we now define, play an important role as 
we head toward defining determinants. 


9.27 definition: 477e77277728 /277775 MA 


SupDOSe 77 1S a DOSitiVe integer. 


e An77-hnear form won is called 277e777g777g if (の ], …, の ) 三 0 whenever 
の … っ の 1Sa Hst of vectors mwith o, ニ ofOr some two distinct Values 
of 7and in 人 1,…,77). 


se の ウニ feV の 2 : ziS an alternating 娘 -Hinear form on り ). 


You should verify that IM is a subspace of VSee Example 9.1S for 
examples of alternating 2-Hnear forms. See Exercise 2 for an example of an 
alternating 3-Iinear form. 

The next result tells us that if a Hinearly dependent list is input to an alternating 


multilinear form, then the output equals 0. 


9.28  g/7e7777774g 772747777777697 / の 77775 7 の /777e67 の 6 の 677e77Ce 


SupPOoSse 777 1S 8 DOsitive integer and z is an alternating 77-Hinear form on V If 


の ], …, の 1S a Hinearly dependent Hist in V then 


g 人 oceea②⑫。) 三 上 


Proof Suppose の 」,…, の 1S a hnearly dependent list in じ . By the Hnear depen- 
dence lemma (2.19), some or is a hnear combination of の,…) の, Thus there 
exist り 」,… Such that の = ニ の 」… キ 太 -1 の 1. Now 


た 1 
(の ],…。 の 。) 三 eoo 2 の の の k+ 1 2 
1 


字 が 。 の が (の っ の - ュ の っ の 。) 


The next result states that 導 7 > dimV then there are no alternating 77-Hnear 
forms on other than the function on "that is identically 0. 


Proof Suppose that wis an alternating 7-hnear form on and の,…) の モビ ど 
Because 77 > dimV this Hst is not Hinearly independent (by 2.22). Thus 9.28 
implies that (の 」,…,6。) 三 0. Hence z is the zero function from V" to F. 
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人 4/7e777777g 7747777777e7 7O77775 977 の /e7777747777O725 


9.30 sw の /772g 772D777 VeC7O7y 72 72 7767777772g 77774777777767 /27777 


SuppOSe 777 1S a DOSitive integer, w 1S an alternating 77-Hnear form on and 


の っ の 15 a list of vectors in じ Then swapping the vectors in any two slots 
of (の ], …, で 6) Changes the value of z by a factor of 1. 


Proof Put o」 + の 。 in both the frst two slots, getting 
0 = み ( の ] 十 の , の ] 十 の , の 5, …, 6) 


Use the multilinear propertes of z to expand the right side of the equation above 
(as in the proof of 9.16) to get 


(の >, の], の 5) …) の 。) 三 一 (の 1 の 2, の 3 …) の )・ 


Similarly, swapping the vectors in any two slots of w( の 」,…, の) changes the 
Value of z by a factor of 一 1. 


To see what can happen with multiple sWaDs, SuDDOse w 1S an alternating 
3-Hnear form on "and , の , の 。 ヒビ To evaluate (の 。, の], の) in terms of 
w( の 」, の 5, の 。), Start with (の 。, の 」, の >) and swap the entries in the frst and third 
slots, getting (の s, の, の っ) 三 (の >, の 」, の s). Now in the 1ast expression, swap the 
entries in the first and second slots, getting 


(の s, の, の っ ) 三 一 W( の っ , の , の く ) 三 (の ], の っ , の 3). 


More generally, we see that if we do an odd number of swaps, then the value of w 
chanees by a factor of 一 1, and we do an even number of swaps, then the value 
of z does not change. 

To deal with arbitrary multiple swaps, we need a bit of information about 
permutations. 


9.31 definitlon: /e7777777777O77, DeTIm 77 


SuDDOSe 77 1S a DOSitiVe integer. 


s Ape772777O7 Of (1,…,77) 1S a hst (7,…) 訪 ) that contains each of the 
numbers 1, .…,77 exactly once. 


es The set of all permutations of (1, .…, 77) 1S denoted by perm 77. 


For example, (2,3, 4,5,1) perm5. You should think of an element of 
perm77 as a rearrangement of the frst 7 positiVe integers. 

The number of swaps used to change a permutation (7 ,… 訪 ) to the stan- 
dard order (1, .…, 娘 ) can depend on the specific swaps selected. The following 
definition has the advantage of assisgning a well-defined sign to every permutation. 
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9.32 definition: s7g7 7 pe77777727O7 


The szg7z of a permutation (7 ,…, 訪 ,) 1S defined by 
Sign(/」, 37) 三 (-1)% 


where / is the number of pairs of integers (た ,!) with1 < た <! く < が such 
that た appears after 【 in the Hst (7,…。 ん) 


Hence the sign of a permutation equals 1 ithe natural order has been changed 
an even number of times and equals 一 1 語 the natural order has been changed an 
odd number of times. 


9.33 example: s7g75 


e The permutation (1,.…,77) [no changes in the natural order] has sign 1. 


e The only pair of integers (ん 6) with た <【 such that た appears after ! in the Hst 
(2, 1, 3, 4) is (1,2). Thus the permutation (2, 1, 3, 4) has sign 一 1. 


e jn the permutation (2,3, .…,77。 1), the only pairs (ん 6) with た <【 that appear 
with changed order are (1,2),(1,3),.…, (1,77). Because we have 77 一 1 such 
pairs, the sign of this permutation equals (1)7ー!. 


9.34 sy の 7725 YO 672776 777 の の 67772777777072 


Swapping two entries in a permutation multiplies the sign of the permutation 
by -1. 


Proof Suppose we have two permutations, where the second permutation is 
obtained from the first by swapping two entries. The two swapped entries Were 
in their natural order in the first permutation if and only they are not in their 
natural order in the second permutation. Thus we have a net change (so far) of 1 
or 一 1 (both odd numbers) in the number of pairs not in their natural order. 

Consider each entry between the two swapped entries. If an intermediate entry 
was originally in the natural order with respect to both swapped entries, then it 
is now in the natural order with respect to neither swapped entry. Similarly, 
an intermediate entry was originally in the natural order with respect to neither 
of the swapped entries, then it is now in the natural order with respect to both 
swapped entries. If an intermediate entry was originally in the natural order with 
respect to exactly one of the swapped entries, then that is still true. Thus the net 
change (for each pair containing an entry between the two swapped entries) in the 
number of pairs not in their natural order is 2, 一 2, or 0 (all even numbers). 

For all other pairs of entries, there is no chanee in whether or not they are in 
their natural order. Thus the total net change in the number of pairs not in their 
natural order is an odd number. Hence the sign of the second permutation equals 
ー1 times the sign of the first permutation. 
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9.35 pe777777777O775 72 77e7777772 772777777776477 / の 77775 


SupDOSe 77 1S a DOSitiVe integer and z 三 V72 Then 


alt 
%( の っ 人 の ) (sign(,… 訪 ) (の ], …, の 。) 


for every Hist の 」,…, の Of Vectors in and all (,…, 訪 ) perm 77. 


Proof Suppose の …。 の 。 ビリ and (の,…, 訪 ) モ perm7z. We can get from 
(っ 方 ) to (1, … 婦 ) by a series of swaps of entries in different slots. Each such 
Swap changes the value of xw by a factor of -1 (by 9.30) and also changes the sign 
of the remaining permutation by a factor of 一 1 (by 9.34). After an appropriate 
number of swaps, we reach the permutation 1, .…,77。 which has sisn 1. Thus the 
Value of z changed siens an even number of tmes if siegn(,…, 訪 ) 三 1 and an 
odd number of times if sign(7,…, 訪 .) ニー1, which gives the desired result. 


Our use of permutations now leads in a natural way to the following beautiful 
formula for alternating ヵ 7-Hnear forms on an 7-dimensional Vector SDace. 


9.36 77/2 67 (dim ソ ) -/772e47 977e772477779 /277779 の 77 レ 


Let 7 = dimV Suppose e」, …, 6 1S a basis of V and の 」,… の For each 
手 介 , .…,7)。 let っ ち , 三 F be such that 


7 
Cr 三 2 の ょ の 
だ た 1 


Then 


4( の の) 三 (っ 6) 0 (SEN(isDUO 9 


方 ) perm77 


Proof Suppose z is an alternating 7-Hnear form won Then 


7 7 
(の ],…。 の ,) 三 a( 》。 か 1 の 計 前 ちら ) 


カニ 1 太 三 


5 5 ュー の 4( の っ っ の) 
( カ ,…) ) 竹 Derm7 


7 (sign の が うち ュー 


(の っ 訪 ) Derm7 


| 
に 
PS 
Q 
RA 
Q 
さ 
ニン 


where the third line holds because (の っ) 0 万,…, 訪 are not distinct 
integers, and the last line holds by 9.33. 
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The following result will be the key to our definition of the determinant in the 
next sectiOn. 


9NB7iitn/ 20 雪 


(dim) 


0 has dimension one. 


The vector space レ 


Proof Let ヵ = dimV Suppose w andw are alternating 7-Hnear forms on with 
w 地 0.Lete」,.…,e, be such that w(e」, .…, 6,) 子 0. There existsc  F such that 


害 (eSssz6) 字 CV 6 の 


Furthermore, 9.28 implies that e, ……,e, 1S hnearly independent and thus is a basis 
of 
SuPpose の …。 の, V Let ち 。 be as in 9.36 for カ た ニー 1,…,7. Then 


W (の ],…。 の ) 


WW (6 6) の 。 (sign( れ ん ュー 


の.… 訪 ) perm 


三 C%(61,…, 6 ) 〉. sign の っ ん) ュー 


の,… 訪 ) Derm7 


三 C( の ],…。 の 。), 


where the frst and last lines above come from 9.36. The equation above implies 
that w = ce. Thus ww is not a linearly independent list。 which implies that 
dimV の <1. 

To complete the proof, we only need to show that there exists a nonzero 
alternating 7 ヵ -linear form z on (thus eliminating the possibility that dim 2 
equals 0). To do this, let e」,…,e, be any basis of and let の 」,…, み の, と V「be 
the linear functionals on that allow us to express each element of as a Hnear 
combination of e」, …,e,. In other words, 


7 
?=〉 の (⑦@ 
7=1 
for every ヒレ (see 3.114). Now for o」,…,o, と define 
9.38 (の ],…, の 。) 三 が (sign の 1 … っ 訪 )) の (の 0)… の 。 (の ,). 
7, っ 訪 ) Derm7 
The verification that z is an 7-Hinear form on is straisghtforward. 

To see that z is alternating, suDDose の ],…。 の ビリ witho。 = ィ ? っ . For each 
( 力 ,… っ 方 ) perm 7, the permutation ( ち , 有 ね) っ 方 ) has the opposite sign. Be- 
cause の 」 三 6 っ , the contributions from these two permutations to the sum in 9.38 
cancel either other. Hence (の ], の ], の 3。 …, の ) 三 0. Similarly, %( の 」,…, の,) 0 ザ 
any two vectors in the Hist o」, .…, の, are edual. Thus z is alternating. 

Finally, consider 9.38 with each ?, = ge. Because の :(@) eduals 0 培 7 チ た and 
equals1 ザ 7 ニ ん た only the permutation (1, .………,7) makes a nonzero contribution to 
the right side of 9.38 in this case, giving the equation w(e],… 6) 三 1. Thus we 
have produced a nonzero alternating 7-linear form z on V as desired. 
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Earlier we showed that the value of 77e /277777 の.38 se 7 77e 7/457 7 の o/ 
an alternating multilinear form applied os が ze g 7 の 7ze7o の /e7g77g 7 
to a linearly dependent Hist is 0: see 9.28. eg 7 c の 7e か o7z 太 e 7 如 
The next result provides a conVerse Of 936 ZZ 7 7772 7ose 7 の 7 が 7 が か 
9.28 for ヵ -Hinear multilinear forms when 方 o 太 e prope777ey O/ g77 77e777g7777g 
7 = dimV In the following result,the 妨 /7 訪 eg7 777. 
statement that w is nonZero means (as 
usual for a function) that x is not the function on "that is identically 0. 


9.39 g/7e777g7777g (dim ソ ) -/777e7 7 の 77775 7 の 777767 77 の 6 の 677e77Ce 


Let 7 = dimV Suppose z is a nonzero alternating 7-Hnear form on 『 and 
ge,… っ 6, 1S a Hst of vectors in / Then 


(0 (GU 


and only 正 」, .…,e, 1S hnearly independent. 


Proof Hirst suppose w(e,…。 6 ) 子 0. Then 9.28 implies that e」, …,e,, 1S Hinearly 
independent. 

To prove the implication in the other direction, noW suDDose 6」, …, 6, 1S Hinearly 
independent. Because 7 = dim ゆ this implies that e」, .…,e,, 1s a basis of (see 
2.38). 

Because z is not the zero 7-IHinear form, there exist o」, .……, の ,  V such that 
(の, の) 子 0. Now 9.36 implies that w(e, .……,e。) 了 チ 0. 


re7c7yey の / 


1 Suppose 77 is a positive integer. Show that dim V の 9 ニ (dim) 学 
2 Suppose7>3andw:FPxFPxEP っ Fisdefned by 
(2 (の っ (ーッ る) ) 
ー が Zs 一 ?5 の Zs 一 Xa7oZ1 ーー X17322 十 ga の ]2 っ 十 え 27321・ 
Show that w is an alternating 3-Hnear form on FY 


3 Suppose 77 1S a positive integer and z is an 7 が -Hnear form on such that 


4( で の, の) 三 0 Whenever の 」,…, の 1Sa Hist of vectors in with の ニ の ょ ュ 


for some7 人 1,…, カ ーー1). Prove that w is an alternating 77-Hnear form on 
4 Prove or give a counterexample: fw IM の then 


(2 の, の 4) 利 V” : a( の の の) ニ U) 


is a subspace of ミキ 
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Suppose 77 1S a Dositive integer and / is an 77-Hnear form on Defne an 
77-linear form wonby 


ルル (の ],…, の ) ヒー 0 (sign の 8( の っ の) 


| 3 太 ) Derm77 
1 (が) 
for oo,…。o。 モザ Explain why w と 


Suppose 77 1S a Dositive integer and / is an 77-Hnear form on Defne an 
77-linear form won by 


0 6) 2 の の) 


の, っ 訪 ) モ Perm77 


foro,…,) の と V BExplain why 
%(Ck …> の k。) 三 W(C],…, の ) 
for all 2,… の and all (,…, ん ん ,) perm 77. 


Give an example of anonzero alternating 2-linear form z on Randalinearly 
independent list o」,o。 in R? such that (の 」, の >) = 0. 


777y ere7c7ye yowy 77g7 9.39 cg7 認 7 が 万 e の po7 が eyy 7 が 47 7 ニー dm ソリ が な 
ge/e7eg7. 
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9C の 6e/e77747777 な 


の e/77777zg 7e の e7e7777777777 


The next definition will lead us to a clean, beautiful, basis-free definition of the 
determinant of an operator. 


Suppose that 7z is a positive integer and 7 と /( ゆ ). For w  V ツ 7. define 


alt > 
ゅ ar Pby 
FTO Os) 三 0UOT UI の) 


for each ist o」,.……, の 。 Of vectors in 


Suppose 7 々 (の ). Ifz 0 and の 」, の 1S a list of vectors in with 


の 三 ok for some7 チ ん then 7 の = 7 ナ o。 which implies that Ar( の 」,…。 の) 
(7 で],…, 7o。) 三 0. Thus the function w ら risaHnearmap of Vi to itself. 

We know that dim 09 = 1 (see 9.37). Every Hnear map from a one- 
dimensional vector space to itself is multplication by some unique scalar. For 


the Hinear map w 中 r, We now define det7 to be that scalar. 


Suppose 了 々 (). The ge7e77772777 Of 了 , denoted by det 了 ア , is defined to be 
the unique number in F such that 


Ar (det アア) w 


forallz と Ve 


9.42 example: ee77777779777S の 7 OD@7 の 7 の 7 ゞ 


Let ヵ 7 = dm 
e If7is the identity operator on thenwr ニ wforalleEV%. Thus det7=1. 


alt * 


e More generally, 半 AF,thenz,=A"ewforalle と VVThus det(47) = ん 7 


alt * 
e Siill more generally,i 7 ん ( じ ) and え FE,then テニ ル "w+ テル "(det ア 7)w 
forallw と VVThus det(A7) = "det 7 


alt * 
e Suppose 了 々 () and there is a basis e , ……,e, Of consisting of eigenvectors 


of 子 , with corresponding eigenvalues A」,…, ん,. fw MA then 
(6 …) 6 三 (ATeT」…。 ん 4 ) 三 (41… ル (6 …) 6)・ 
Ifz 也 0, then 9.39 implies w(e」, .…, 6,,) 了 チ 0. Thus the equation above implies 


det 了 ーー ルール 
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Our next task is to define and give a formula for the determinant of a square 
matrix. To do this, we associate with each square matrix an operator and then 
define the determinant of the matrix to be the determinant of the associated 
Operator. 


9.43 definition: の e7e77777777 の 7 の 7 の 7 が det 人 ん 


Suppose that 7 iS a positive integer and 4 is an 7-by-7 square matrix with 
entries in F. Let 7 々 (F") be the operator whose matrix with respect to 
the standard basis ofF" equals 4. The 2e7e7777g77 Of 人 4, denoted by det 4, is 
defined by det4 = det ア . 


9.44 example: の e7e777277297279 の / 7 の 77C6y 


e Tf7isthe7-by-7 identity matrix, then the corresponding operator on F" is the 
identity operator Jon FThus the frst bullet point of 9.42 impiies that the 
determinant of the identity matrix is 1. 


e Suppose 4 is a diagonal matrix with 和 」,…, ん, on the diagonal. Then the 
corresponding operator on F" has the standard basis of F" as eigenvectors, 
with eigenvalues ん 」,…, ん. Thus the last bullet point of 9.42 implies that 
det4 ニル 4」… ん ルル 


For the next result, think of each Hst o」,… の 。 Of 7 VectorsinF7asaHstof 
7-by-1 column vectors. The notation ( の 」 … の ) then denotes the 7-by-7 
square matrix whose AP column is o for each た = 1,.…,7. 


9.45 ge/e7777777d777 75 72 776777777778 7777777777767 /27777 


Suppose that 77 1S a positive integer. The map that takes a Hst の 」,.……, の of 
Vectors in F" to det ( の 」 … の ) is an alternating 77-Hnear form on F* 


Proof Let e」, …,e, be the standard basis of F"and suppose の ,…, の, 1S a list of 
Vectors in FX Let 了 アー 々 (F") be the operator such that Te = の for た = 1,…,7. 
Thus 7 is the operator whose matrix with respect to ,…,6iS( の … の ). 
Hence det( o」 … o, ) = det7, by definition of the determinant of a matrix. 
Let be an alternating 7-Hnear form on F” such that (6」, .……,6,) = 1. Then 


det( o」 … og, )=det7 
ー (det 了 了 ) w(e, .…,e。) 
三 %( 了 6],…, 了 6 ) 
三 (の ], > の ,)。 
where the third Hine follows from the definition of the determinant of an operator. 


The equation above shows that the map that takes a Hst of vectors の , …, の in F" 
to det ( の 」 … の , ) isthe alternating 7-Hinear form won F' 
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The previous result has several important consequences. For example, it 
immediately implies that a matrix with two identical columns has determinant 0. 
We will come back to other consequences later, but for now we want to give a 
formula for the determinant of a square matrix. Recall that if 4 isa matrix, then 
4 denotes the entry in roW ヵ column kof 4 


9.46 /27774/4 27 の 67e77747779777 の 7 77747 


Suppose that 77 iS a positive integer and 4 is an 7-by-7 square matrix. Then 


det4= ー 2 (sign の eo) ュー 


( カ , 方) perm7 


Proof Apply 9.36 with = and e」,…,e, the standard basis ofEF7 and the 
alternating 7-linear form on F" that takes の 」,…, の, tO det ( の 」 … の , ) [see 
9.45]. Hf each z。 is the column of 4, then each な rm 9.36 equals 4 Finally, 


(esse6) 三 OBM( 大 … %) ヨ deM こ 1 


Thus the formula in 9.36 becomes the formula stated in this result. 


9.47 example: eX//7c7 77777477 7 の 7 の e7e7772777777 


e If4 isa2-by-2 matrix, then the formula in 9.46 becomes 


det 4 ヒー 4 ュ 1245 > = ノ 2 141 >. 


e jf 4 isa3-by-3 matrix, then the formula in 9.46 becomes 
det4 =4」 145 248 ュー 45141 48 5 一 45145 41 3 
4 っ 4 45 4 241 3. 


The sum in the formula in 9.46 contains 7! terms. Because 7! grows rapidIy as 
7 increaseSs, the formula in 9.46 is not a Viable method to evaluate determinants 
even for moderately sized 7. For example, 10! is over three million, and 100! js 
approximately 101??, leading to a sum that the fastest computer cannot evaluate. 
We will soon see some results that lead to faster evaluations of determinants than 
direct use of the sum in 9.46. 


9.48 ge/e7777772777 の 7 4 の の 67-7777287777 7774777Y 


Suppose that 4 is an upper-triangular matrix with A」, .…, ん, on the diagonal. 
Then det 4 = 4」… ル ,. 


Proof ( カ ,…, 訪 ) perm7 with (7 ,…, 訪 ) 孝 (1, …,7), then > for some 
k 6 休 ,…, 妃 , which implies that 4。 = 0. Thus the only permutation that 
can make a nonzero contribution to the sum in 9.46 is the permutation (1, .……, 7). 
Because 4, = 4 foOr each た = 1 …,7, this implies that det 4 ニル 1… ん 。. 
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7o/e777ey の 7 e7e777277777779 


Our definition of the determinant leads to the following magical proof that the 
determinant is multplicative. 


9.49 ge/e7777777777 75 77777777 の 77C77e 


(a) Suppose 5,7 6 々 (). Then det(57) = (det5)(det7). 


(b) Suppose 4 and ぢ are square matrices of the same size. Then 


det(4p) = (det 4)(det ぢ ) 


Proof 
(a) Let ヵ = mV Suppose ee V ツ 2 and o」,…,o。 と Then 


al 
cr( の 1 …。 の ) 三 (5 了 の ],…, 57 の, ) 
三 (det 5)w(7 の 」,…, 了 6, ) 
三 (det 5)(det7)( の 」, .…,,), 
where the first equation follows from the definition ofw。+, the second equation 


follows from the definition of det 5, and the third equation follows from the 
definition of det7. The equation above implies that det(57) = (det S)(det7). 


Let 5,7 と 々 (TE”) be such that 77(5) = 4 and 7 (7) = p, where all matrices 
of operators in this proof are with respect to the standard basis of FX Then 
27(57) = 7(S)77 (7) = 4p (see 3.43). Thus 


det(4p) = det(57) = (det 5)(det 7 ア ) = (det 4)(det ぢ ), 


(b 


ゝ ュ ン 


where the second equality comes from the result in (3). 


The determinant of an operator determines whether the operator is invertible. 


9.50 7ve777 の /e < っ 7O72Ze7 の O ee7777777777 


An operator 7 々 () is invertble if and only 半 det7 チ 0. Furthermore, 下 


7 is invertible, then det(7ー) = ェ ー. 


Proof First suppose 7 is invertible. Thus 77ー = 7. Now 9.49 implies that 
1 = det 了 = det(7Tー) = (det7)(det(7ー)) ) 
Hence det7 也 0 and det(7ー)) is the multiplicative inverse of det7* 
To prove the other direction, now suppose det ア チチ 0. Supposeo と Vand 


? 子 0.Let o, ら ,.…,e, be a basis ofVandletz VI be such thatz チ 0. Then 
(の, > … っ 6) 0(by 9.39). Now 


w(7 の , 了 76.…, 了 6) 三 (det 了 ア ) み (の, 5, …, 6 ) 邦 0, 
Thus 7? 0. Hence 7 is inVertible. 
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An 7-by-7 matrix 4 is invertible (see 3.80 for the definition of an invertible 
matrix) if and only if the operator on F" associated with 4 (Via the standard basis 
of F") is invertible. Thus the previous result shows that a square matrix 4 is 
invertble if and onlyifdet4 チ 0. 


9.51  e7ge7zv/7zey 77 7e7e77777777775 


Suppose 7 々 ( じ ) and ん F. Then ん is an eigenvalue of and only ぜ 
det(47ー ア 7) = 0. 


Proof The number ん is an eigenvalue of 隊 and only アー 47 is not inVertible 
(see 5.7), which happens if and only ff リー is not invertible, which happens if 
and only if det(4 ル チー ア ) = 0 (by 9.50). 


Suppose 7 と 々 () andS5: Wー ツ is aninvertible linear map. To prove that 
det(5-!7S) = det7, we could try to use 9.49 and 9.50, writing 


det(5-17S) = (det 5-})(det 7)(detS) 
ー det 7 


That proof worksif W = ニ Vbutif W チ Vthen it makes no sense because the 
determinant is defined only for Hinear maps from a Vector space to itself, and 5 
maps W tomaking det 5 undefned. The proof given below works around this 
issue and is valid when W テ 


9.52 ge/e7777777d777 75 の S7777772777 72UDG77777 


Suppose 7 三 々 ( じ ) andS: W っ Vis an invertible hinear map. Then 


det(S-17S) = det7: 


Proof Letz=dimW=dmVSupposereW や DefneweW%by 
(ka (9 Oo e 
for の 」,…, の, ビ V Suppose の ],…, の W. Then 
ESes(0i0。 二 (9 00 56 ) 

三 w(7 ナ 5 の ], …, 了 5 の ) 
三 Ar(5 の ], …) 5 の 。) 
(det ア ) み (5 の 」, .…, 5 の 。 ) 
三 (det ア ) て (< の] , …, の 。) 


The equation above and the definition of the determinant of the operator 5~!7S 
imply that det(5~!75) = det 子 
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For the special case in which = FE" and e」,.…,e, 1S the standard basis of F" 
the next result is true by the definition of the determinant of a matrix. The left 
side of the equation in the next result does not depend on a choice of basis, which 
means that the right side is independent of the choice of basis. 


9.53 ge/e7777777727 の 7 O/67 の 7O7 6747/S の e/67777777777 O/ 775 777777 


Suppose 7 三 々 ( ぴ ) and e」,…, e, 1S a basis of Then 


det7 = det 77 (7, (e」,… g,)) 


Proof Let 方 ,…, 刻 be the standard basis ofF".Let5: 思 っ bethe Hinear 
map such that 5 ん = eforeach た = 1,.……,7. Thus 77(5, (方 ,…, 刻 ), (1, …, 6。) ) 
and 77 (5-], (6,.…e。 ), (方 ,…, 刻 ) ) both equal the ヵ -by-7 identity matrix. Hence 


9.54 70f(9_ 9 (ん ) ニ が. ここら) 
as follows from two applications of 3.43. Thus 
det7 = det(5-T75) 
GMC(9mW の の (。。 あ ) 
三 det 77 (7, (6 .…, 6。) ), 


where the first line comes from 9.52, the second line comes from the definition of 
the determinant of a matrix, and the third line follows from 9.34. 


The next result gives a more intuitive way to thinK about determinants than the 
definition or the formula in 9.46. We could make the characterization in the result 
below the definition of the determinant of an operator on a finite-dimensional 
complex Vector space, with the current definition then becoming a consedquence 
of that defimition. 


9.55 が ドニ C, 娘 e7, 67e77777779777 69747/9 の 7 の の 74C7 の / 67ge72P7746y 


SupposeF = Cand7 と (ゆり). Then det 7 equals the product of the eigen- 
Values of 了 , with each eigenvalue included as many times as its multiplicity. 


Proof There is a basis of V with respect to which 7 has an upper-triangular 
matrix with the diagonal entries of the matrix consisting of the eisgenvalues of 了 ア 
with each eigenvalue included as many times as its multplicity 一 see 8.37. Thus 
9.53 and 9.48 imply that det7 equals the product of the eigenvalues of 了 7, with 
each eigenvalue included as many times as its multiplicity. 


As the next result shows, the determinant interacts nicely with the transpose of 
a square matrix, with the dual of an operator, and with the adjoint of an operator 
on an inner Droduct SDace. 
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9.56 ge/e7777777d777 の 7 7 の 775DOS6, の 77, O7 777777 


(a) Suppose 4 is a square matrix. Then det 4「 = det 4. 


(b) Suppose 7 々 ( ゆ ). Then det7” = det ア 


(c) Suppose V is an inner product space and 了 7 々 (ゆり ). Then 


det(7*) = det7 ア 


Proof 


(⑧ 


(b 
(9 


ヽ ュ ン 


Let 7 be a positive integer. Defne w: (F^) "っ Eby 


t 
g(( 2 や の ) ) 三 det(( の 」。 … の , ) ) 
for all の 」,…, の, FThe formula in 9.46 for the determinant of a matrix 
shows that w is an 7-Hnear form on FL 


SuPDOSe の 」, の 所 F” ando ニ IOr some7 チ た Pis an77-by-7 matriX。 


then ( の ] … の ) g cannot equal the identity matrix because row / and 
row た of( の … の ) g areequal.Thus( の 」。 … の is not invertible, 
which implies that g(( の … の ) ) = 0. Hence js an alternating 7- 


Hinear form on FE 


Note that w applied to the standard basis ofF" equals 1. Because the vector 
Space of alternating 7-Hnear forms on F” has dimension one (by 9.37), this 
implies that x is the determinant function. Thus (a) holds. 


The equation det ア "= det ア follows from (a) and 9.53 and 3.132. 


Pick an orthonormal basis of The matrix of 7* with respect to that basis is 
the conjugate transpose of the matrix of 了 with respect to that basis (by 7.9). 
Thus 9.53, 9.46, and (8) imply that det(7*) = det 好 


9.57 /e/ の 27 7es74/75 777 6Vg/7497777g の 67677777777775 


Tf either two columns or two rows of a square matrix are equal, then the 
determinant of the matrix equals 0. 


Suppose 4 is a square matrix and ぢ is the matrix obtained from 4 by 
Swapping either two columns or two rows. Then det 4 ニーdet p. 


Tf one column or one row of a square matrix is multiplied by a scalar, then 
the value of the determinant is multiplied by the same scalar. 


T a scalar multiple of one column of a square matrix to added to another 
column, then the value of the determinant is unchanged. 


Tf a scalar multiple of one row of a square matrix to added to another row, 
then the value of the determinant is unchanged. 
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Proof All the assertions in this result follow from the result that the maps 
の の は det( の … る )andg の gg ロ det( の の … の ) are both 
alternating 7-linear forms on F” |see 9.4S and 9.56(a) | . 

For example, to prove (d) suppose の 」, …, の, F" andcF. Then 


det( の +eoo の … の ) 
=det( o」 の 。 … の 。)+cdet( go の の 3 … の ) 
=det( og の … の 。), 


where the first equation follows from the multlinearity property and the second 
equation follows from the alternating property. The equation above shows that 
adding a multiple of the second column to the first column does not change the 
Value of the determinant. The same conclusion holds for any two columns. Thus 
(d) holds. 

The proof of (e) follows from (d) and from 9.56(a). The proofs of (3), (b), and 
(c) use similar tools and are left to the reader. 


For matrices whose entries are concrete numbers, the result above leads to a 
much faster way to evaluate the determinant than direct application of the formula 
in 9.46. Specifically, apply the Gaussian eimination procedure of swapping 
rows |by 9.48(b), this changses the determinant by a factor of -1|, multiplying 
a row by a nonzero constant [by 9.48(c), this changes the determinant by the 
same constant |, and adding a multiple of one row to another row [by 9.48(e), this 
does not change the determinant | to produce an upper-triangular matrix, whose 
determinant is the product of the diagonal entries (by 9.48). Tf your software keeps 
track of the number of row swaps and of the constants used when multplying a 
row by a constant, then the determinant of the orisinal matrix can be computed. 

Because a number 人 ん Fisan eisenvalue of an operator 了 と 々 ( ゆ ) if and 
only i det(47ーT ア ) = 0 (by 9.51), you may be tempted to think that one way 
to find eigenvalues quickIy is to choose a basis of let 4 = 77), evaluate 
det(47 一 4), and then solve the equation det(47 一 4) = 0 for ん . However, that 
procedure is rarely eficient, except when dim ソ = 2 (or when dim V equals 3 or 
4 i you are wiliing to use the cubic or quartic formulas). One problem is that the 
procedure described in the paragraph above for evaluating a determinant does not 
work when the matrix includes a symbol (such as the ん Ain 47ー4). This problem 
arises because decisions need to be made in the Gaussian elimination procedure 
about whether certain quantities equal 0, and those decisions become complicated 
in expressions involving a symbol 人 . 

Recall that an operator on a fimite-dimensional inner product sDace 1S unitary 
if it preserves norms (see 7.51 and the parasraph following it). Every eigenvalue 
of a unitary operator has absolute value 1 (by 7.54). Thus the product of the 
eigenvalues of a unitary operator has absolute value 1. Hence (at least in the case 
F =C) the determinant of a unitary operator has absolute value 1 (by 9.55). The 
next result gives a proof that works without the assumption thatF =C. 
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9.58 eve7y 77277477y の DP67 の 7O7 5 の e767777777777 7777 の yo77/7e ug77/e 1 


Suppose V is an inner product space and 5 三 々 () is a unitary operator. 
Then |det 5| = 1. 


Proof Because 5 is unitary, 7 = 5*S (see 7.53). Thus 
1 = det(5*5) = (det 5*)(det 5) = (det 5)(det 5) = |det 5 し 


where the second equality comes from 9.49(a) and the third equality comes from 
9.56(c). The equation above implies that |det 5| = 1. 


The determinant of a positive operator on an inner product space meshes well 
with the analogy that such operators correspond to the nonnegative real numbers. 


9.59 eve7y OS77Z7Ve O/677 の 7 775 720727768977De の e7677777727777 


Suppose V is an inner product space and 7 ん () is a positive operator. 
Then det ア > 0. 


Proof By the spectral theorem (7.29 or 7.31), V has an orthonormal basis con- 
sisting of eieenvectors of 了 . Thus by the last bullet point of 9.42, det7 equals a 
product of the eisenvalues of 7, possibly with repetitions. Each eigenvalue of7is 
a nonnegative number (by 7.38). Thus we conclude that det ア > 0. 


Suppose V is an inner product space and7 と 々 (). Recall that the Hist of 
nonnegative sduare roots of the eigenvalues of 7*7 (each included as many times 
as its multiplicity) is called the list of singular values of 了 (see Section 7E). 


9.60 |det7| = p7og7c7 の 7 s772g74747 V7ey の 7 


Suppose V is an inner product space and7 と 々 ( ゆ ). Then 


ldet 7| = (det(7 生 7) = product of singular Values of 刀 


Proof Wehave 
Idet 7 = (det7)(det7) = (det(7*) )(det7) = det(7* げ 7), 


where the middle equality comes from 9.56(c) and the last equality comes from 
9.49(a). Taking square roots of both sides of the equation above shows that 
Idet ア | = det(7 パ ポア). 

Let s」,…,s, denote the list of singular values of 李 Thus 5 る.…s5Z is the 
list of eigenvalues of 7*7 (with appropriate repetitions), corresponding to an 
orthonormal basis of 『 consisting of eigenvectors of “7. Hence the last bullet 
point of 9.42 implies that 

det(7* ア ) = 5 で …5 る 


Thus Idet | = s」…s, as desired. 


7? 


Section 9C Determinants 363 


An operator 了 on a real inner product space chanees volume by a factor of the 
product of the singular values (by 7.111). Thus the nextresult follows immediately 
from 7.111 and 9.60. This result explains why the absolute value of a determinant 
appears in the change of Variables formula in multivariable calculus. 


9.61 cees vo7z777e の 7c7o7 の 7 |det 7| 


Suppose 7 と 々 (R7) and OCR7 Then 


volume7(()) = |det 7 ア |(Volume ()). 


For operators on fimite-dimensional complex vector SDaces, We nOW connect 
the determinant to a polynomial that we have previously seen. 


9.62 が ガ が ドニ C, 7 娘 e7 c/Z72c7e77577C DO/74 の 77777 の 7 7 es det(z チ ー ア 7) 


SupposeF = Cand 了 と バ (). Let A」, .…, ん denote the distinct eigenvalues 
of 了 , and let 7, …… の denote their multiplicities. Then 


det(z7ー ア ) ニ (Z 一 AA) 折 …(2 ん ん) 


Proof There exists a basis of with respect to which 7 has an upper-triangular 
matrix with each ん, appearing on the dagonal exactly み tmes (by 8.37). With 
respect to this basis, 7ー ア has an upper-triangular matrix with z 一 侯 , appearing 
on the diagonal exactly み tmes for each た . Thus 9.48 gives the desired equation. 


SupposeF =Cand 了 と る Z( ゆ ). The characteristic polynomial of7 was 
defined in 8.26 as the polynomial on theright side of the equation in 9.62. We 
did not previously define the characteristic polynomial of an operator on a finite- 
dimensional real vector space because such operators may have no eigenValues, 
making a definition using the right side of the equation in 9.62 inappropriate. 

We now present a new definition of the characteristic polynomial, motivated 
by 9.62. This new definition is valid for both real and complex Vector SDaces. 
The equation in 9.62 shows that this new definition is equivalent to our Drevious 
definition whenF =C (8.26). 


9.63 definition: c772c7e77577C の /y72 の 7777/ 


Suppose 7 6 々 ( ぴ ). The polynomial defined by 


Zr> det(z チ ー ア ) 


is called the c27gc7e77577C の 7 の 7777/ Of 


The formula in 9.46 shows that the characteristic polynomial of an opera- 
tor 了 と イズ ( ゆ ) is a monic polynomial of degree dm The zeros in F of the 
characteristic polynomial of 7 are exactly the eisenvalues of 了 (by 9.51). 
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Previously we proved the Cayley-Hamilton theorem (8.29) in the complex 
case. Now we can extend that result to operators on real vector SDaceS. 


9.64 Cgy/ey-- 刀 777777O77 777eO76777 


Suppose 7 々 ( じ ) andgis the characteristic polynomial of 7. Then 7(7) = 0. 


Proof TTF =C, then the equation 97) = 0 follows from 9.62 and 8.29. 

Now supposeF =R.Fixabasisofandlet4bethematrix of ア with 
respect to this basis. Let S be the operator on CV such that the matrix of 5 
(with respect to the standard basis of Cm『) is 4.ForallzーR wehave 


7(Z) = det(z チ ー ザ ) = det(zJー 4) = det(z7ー 5). 


Thus 4 is the characteristic polynomial of 5. The caseF = C (frst sentence of 
this proof) now implies that 0 = (5) = (4) = 47(7). 


The Cayley-Hamilton theorem (9.64) implies that the characteristic Dolyno- 
mial ofan operator 了 々 ( ぴ ) is a polynomial multple of the minimal polynomial 
of (by 5.29). Thus the desree of the minimal polynomial of 了 ア equals dm 
then the characteristic polynomial of 7 equals the minimal polynomial of 7. This 
happens for a very large percentage of operators, including over 99.9999。 of 
4-by-4 matrices with inteser entries in [一 100, 100] (see the paragraph following 
23) 

The last sentence in our next result was previously proved in the complex case 
(see 8.54). Now we can give a proof that works on both real and complex vector 
SDaCCS. 


9.65  c/Z7c7e77577C の 74O77777, 77C6, 777 67677777770777 


Suppose 7 々 (). Let 7 = dm Then the characteristic polynomial of 子 
can be written as 


2 (tt (りり 7(de67) 


Proof The constant term of a polynomial function of z is the value of the poly- 
nomial when z = 0. Thus the constant term of the characteristic polynomial of 子 
eduals det(-- ず ), which equals (1)" det 了 (by the third bullet point of 9.42). 

Fix a basis of and let 4 be the matrix of 了 with respect to this basis. The 
matrix Of ガー ア with respect to this basis is ヶ 7 ー 4. The term coming from the 
identity permutation {1, .…,7} in the formula 9.46 for det(z7ー 4) js 


( 々 一 41 1)…( る ー の 


The coeficientof ダ ー} in the expression above is 一 (4」 」+…+4。。), which equals 


ーr 了 7 ア . The terms in the formula for det(<J ー 4) coming from other elements of 
Perm 7 Contain at most カ ー2 factors of the form z-4, ,and thus do not contribute 
to the coeficient of z7ー} in the characteristic polynomial of 李 
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Im the result beloW, think of the 77e eX7 7657477 YY の 9 7OV@9 の 4c の 776 ゞ 
columns of the 7-by- ヵ 7 matrix 4asele- ZZ (7865-7963) 7893 
ments of F The norms appearing below 
then arise from the standard inner product on F". Recall that the notation R , 
the proof below means the column of the matrix R (as was defined in 3. 衝 


9.66 刀 Z477777 776 の 777 


Suppose 4 is an 7-by-7 matrix. Let の , …, の , denote the columns of 4. Then 


7 
ldet4| < | | le 


誠志 


Proof _T 4 is not invertible, then det4 = 0and hence the desired inequality 
holds in this case. 

Thus assume that 4 is invertible. The QR factorization (7.58) tells us that 
there exist a unitary matrix 〇 and an upper-triangular matrix whose diasonal 
contains only positive numbers such that 4 = OR. We have 


Idet 4| = |det O| Idet RI 
三 |det AI 


7 
ー | | ll, 


where the first line comes from 9.49(b), the second line comes from 9.38, the 
third line comes from 9.48, and the fifth Hine holds because O is an isometry. 


To give a geometric interpretation to Hadamard's inequality, suppose F = R. 
Let 了 と 々 (R7) be the operator such that 7e, = or for each = 1,.…,7, where 
e1,…。 6。 1S the standard basis of R" Then 了 maps the box ア (e,.…,e,) onto the 
parallelepiped P(?」,…, の ,) [see 7.102 and 7.103 for a review of this notation 
and terminology]. Because the box P(e」,.…,e,) has volume 1, this implies (by 
9.61) that the parallelepiped P(o,.…,,) has volume Idet7|, which equals Idet 4|. 
Thus Hadamard's inequality above can be interpreted to say that among all paral- 
lelepipeds whose edges have lengths |o」, .…, ol, the ones with largest volume 
have orthogonal edges (and thus have volume I 馬 - W ll 

For a necessary and sufhcient condition for Hadamard's inequality to be an 
eduality, see Exercise 18. 
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The matrix in the nextresult is called the V47de7777o7e 7 が 7 克 . Vandermonde 
matrices have important applications in polynomial interpolation, the discrete 
Fourier transform, and other areas of mathematics. The proof of the next result is 
a nice illustration of the power of switching between matrices and Hinear maDs. 


9.67 ge/e7777777777 の / 72e7777O7e 7 


Suppose 7 > 1 and p」, …,。 F. Then 
1 皇 


1 あめ 


Proof Let 1,z,.…,27ー1 be the standard basis of の 」(F) and let e」,.…,e, denote 
the standard basis ofF* Defme a hnear mapS: の _」1F) っ FEF' by 


S 三 (の (gi), sp 


Let 4 denote the Vandermonde matrix shown in the statement of this result. 

Note that 
狂 00(0 (2 らち )) 

Let ア グー_」(F) っ の,_」(F) be the operator on の グ ,_」(F) such that 1 = 1 

and 
7 = ニー)(z 一 了 め )…( 々 ーP 

NE たま 性 1 ムー1L LeKB ニ (YO 。 の の に Then Bs an 
upper-triangular matrix all of whose diagonal entries edual 1. Thus detp =1(by 
9.48). 

Let C = 7(87, (1,2,…,27ー リ 、(g」.…,g,)). Thus C = 4p (by 3.81), which 
implies that 

det 4 = (det4)(det p) = detC. 


The definitions of C, 5, and 了 show that C equals 


1 0 0 ss 0 
1 め ー 臣 0 ko 0 
1 一 証 (96。 一 ぬ )(6。 一 あめ) … 0 


1 一 (6。 一 )(6。 一 あめ ) Oi デー し ルル ) 
Now det4 = detC = 剛 (上 & 一 訪 ) where we have used 9.56(a) and 9.48. 


1 </< た <7 
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re7czyey 9 


10 


11 


Prove or give a counterexample: 5,7 ん () = っ det(5+ ア ) = det 5+det 了 7 


Suppose the first column of a square matrix 4 consists of all zeros except 
possibly the first entry 4」 」. Let p be the matrix obtained from 4 by deleting 
the first roW and the first column of 4. Show that det 4 = 4」 det p. 


Suppose 7 (げじ ) is nilpotent. Prove that det7+ ア ) = 1. 
Suppose 5 々 (). Prove that 5 is unitary if and only i ldet 5| = ISI| = 1. 


Suppose 4 is a block upper-triangular matrix 


パイ * ネ 
4 イニ … ) 
0 2。 


where each Ar along the diagonal is a square matrix. Prove that 
det4 = (det4」)…(det4。). 


Suppose4 ニ ( o」 … の , )iSan7-by-z matrix, with o, denoting the 
column of 4. Show that if (77,.…,77。) perm 7, then 


det( の 。。 … の の) ニ (Sign( が っ 功 。)) det 4. 


Suppose 7  () is invertible. Let p denote the characteristic polynomial 
of 7 and let 7 denote the characteristic polynomial of 7ー!. Prove that 


e- 訓 の 6 


for all nonzero z と F. 


Suppose 7 と 々 () is an operator with no eigenvalues (which implies that 
F=R). Prove that det ア ッ >0. 


Suppose that is a real vector space of even dimension, 7 々 ( ぴ ), and 
det7 <0. Prove that 7 has at least two distinct eigenValues. 


Suppose V is a real Vector space of odd dimension and7 と 々 ( ゆ ). Without 
using the minimal polynomial, prove that 7 has an eigenvalue. 


7775 7es7477 WS の 76V7O7457y の 7 の Ve の 7777O77 749775 の e767777777775 O7 777e 7 の C- 
7e77577C の 74O777 の /--yee う . う イプ . 


Prove or give a counterexample: IIF=R, 了 7 と ん ( ゆ ), and det ア > 0, then 
了 has a sduare Toot. 


が F = アア と の ( ゆ ), gz det ソチ 0, 万 ez 72y 2 5 の 7e 7 の OO7 (see 6. ). 
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Suppose 5, 了 7 と 々 () and S is invertible. Defnep:FーFby 
ヵ (Z) = det(zS 一 了 ). 


Prove that ヵ is a polynomial of degree dim ソ and that the coeffcient of zdmY 


in this polynomial is det 5. 


SupposeF = で, アーバ ( ゆ ),and7 = dm リッ > 2. Let A」,…, 4, denote 

the eigenvalues of 了 , with each eigenvalue included as many tmes as its 

multiplicity. 

(a) Find a formula for the coeffcient of z7ー^ in the characteristic polynomial 
of ア in terms of A」,… 和 ん,. 

(b) Hind a formula for the coeficient of z in the characteristic polynommial 
of ア in terms of A」,… 和 ん,. 


Suppose V is an inner product space and 了 is a positive operator on Prove 


that 
detV7 = vVdet7. 


Suppose V is an inner product space and ア と 々 (). Use the polar decom- 
position to give a proof that 


ldet7| = det(7*7) 


that is different from the proof given earlier (see 9.60). 


Suppose 7 と ズ ( ゆ ). Defne es:F っ ーFby es(y) = det7+ ァ 7). Show that 
@(0) = エア 
oo ん 7 9 c/e72 SO77477 の 77 7 の 7779 ere7C75e, W7770O7 7725 7 が e eX//7c77 の 7 
co77//7cg7ed 7 の 7777477 /27 777e de/e777772 の 777 の 7 が 


Suppose , り ,c are Dositive numbers. Find the volume of the ellipsoid 


2 の ー ジ 
1 の eR っ + 注 っ < リ 

by finding a set () て R* whose volume you know and an operator 7 on R? 

such that 了 (()) equals the eliipsoid above. 


Suppose that 4 is an invertble square matrix. Prove that Hadamard's 
inequality (9.66) is an equality if and only if each column of 4 is orthogonal 
to the other columns. 


Suppose V is an inner product space, 6」, …,6, 1S an orthonormal basis of 

and ア 7 と イズ () is a positive operator. 

(8) Prove that det7< [7ee/)- 

(b) Prove that 了 is invertible, then the inequality in (a) is an equality 下 
and only if eis an eigenvector of7 for each た = 1,.…,7. 
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20 Suppose 4 isan ヵ -by-7 matrix, and suppose cis such that 4 | <cfor al 
ヵ た 人 (1, …,77). Prove that 


Idet 4| < cr の 


77e ん 77 7 7 が e の e7e777777777 の 7 6 7 の 777y (9.26) ys 7 が 7 ldet 4| < く の 台 . 
刀 oweve7 7e 65777777e 87Ye7 の 7775 eXe7C7Se 75 774C77 の e77e7: の 7 er7 の /e, が 
c ニ 1gz の 7 = 100, ez cl 10159 47 7e 657 の 7e 7Ve77 の y 万 ere7C7se 
が 7 が e ze7 yg77er7 72 の er 10100 が ァ カ が s 2 7 が eger oer の げ 2, 7e7 7e 
72697777” の の ove 5 57 の 7 の 77 の Cg777707 e 7 の 7 の ve の . 


21 Suppose 7 is a positive integer and 6: で 7P ア っ Cisafunction such that 
6(4p) = 6(4)・9( ぢ ) 


for all 4Jp と で の 7 and 6(4) equals the product of the diagonal entries of 4 
for each diagonal matrix 4 で CC"7. Prove that 


8(4) = det4 


for al4EC7 


ecg// 7727 C の 7 7e77O7ey ye7 の 7 7- の y-7 7777Cey 777 e7777ey 7 CC. 7775 
eXe7C7Se SOWS 万 7 7e 7e7e777779777 75 77e 777746 777C77O77 の 776 O77 774976 
779777C@ 7 の 7 75 7774777 の 77cg7 が Ye 7 の 5 7 が e の ey7e の eV7O7 の 7 の 7 の 77G/ 
7 の 777Ce5. 777S 7ey777 5 97 の goz7y 7 の Ye7c7se 70 77 Sec7o7 6 の , 7zc7 
sos 777 77e 7 の Ce 75 727746/y の e7e77727776 の の 775 7ge の 77C の 7 の の 6777@ ふ . 


Ifind that in my own elementary lectures, I have, for pedagogical reasons, Dushed 
determinants more and more into the background. Too often I have had the expe- 
rience that, while the students acquired facility with the formulas, which are so 
useful in abbreviating long expressions, they often failed to gain familharity with 
ther 7eg77g, and skill in manipulation prevented the student from going into al 
the details of the subject and so gaining a mastery. 


一 7e77e77 の 7y 7477e7777Cy 方 o77 の 7 4 の yg7ce の 57g77 の の o777- Ceo7ze が 7y。 Felix Klein 
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9 の 767so7 /7og7c7y 


7e75O7 7og7/c7 o/ 7iyO Vec7O7 5/gcey 


The motivation for our next topic comes from wanting to form the product of 
avector の and a Vector の  W. This product will be denoted by の @ の , 
pronounced “の tensor の and will be an element of some new vector space called 
Ve@ W (also pronounced “tensor W”). 

We already have a Vector space x W (see Section 3E), called the product of 
and W. However, x W will not serve our purposes here because it does not 
provide a natural way to multiply an element of by an element of W. We would 
jike our tensor product to satisfy some of the usual properties of multiplication. 
For example, we would like the distributive property to be satisfied, meaning that 
if の], の 。, の ビリ and の の, の 。, の WW, then 


(の 」 エ の 2)@ の ⑦ の ー ニ の 1@⑳@⑦ 十 の >⑳ の and の @(」 二 の ⑦>) の @⑦」 二 の @(⑰>. 


We would also Hike scalar multiplica- 
tion to interact well with this new multi- 
pliication, meaning that 


7 /7 の gce @ 77 7 の pe \otimes. 


ル ん (? ⑳ の ⑦) 三 (の ) @ の ニニ の @⑳@(A ん の ) 


forall え と FE の と andw と MW. 

Furthermore, it would be nice if each basis of Y when combined with each 
basis of W produced a basis of V@ W. Specifically, if eg」,…, ge 1S a basis of 
and 方 ,…, 訪 1S a basis of W, then we would Hike a list (in any order) consisting 
ofe@ 太 as7ranges from 1 to 77 and た ranges from1to7 ヵ tobeabasis of 
Ve W. This implies that dim(V@ W) should equal (dim じ )(dim W). Recall that 
dim( ソ x W) = dimY+ dim W (see 3.92), which shows that the product "x W 
will not serve Our DuTDOSes here. 

To produce a vector space whose dimension is (dim り ) (dim W) in a natural 
fashion from and W, we look at the vector space of bilinear functionals, as 
defined below. 


9.68 gdefinition: /7/77eg7 472c7O727 o77 V x W 7 娘 e vec7o7 spgce グ (V W) 


e A /777eg7 72c7o7 の 7onx WisafuncttonB:VxW っ Fsuchthat 


の ( の , の ) 1S a Hnear functional on for each o  W and ひら (の ⑦, の ) 
is a linear functional on W for eacho と 


e The vector space Of bilinear functionals on x MW is denoted by 少 ( W). 


Tf WW = リ , then a bilinear functional on V x W is a bilinear form: see 9.1. 

The operations of addition and scalar multplication on グ ( W) are defined 
to be the usual operations of addition and scalar multplication of functions. As 
you can verify, these operations make グ (V W) into a vector space whose additive 
identity is the Zero function from V x W toF. 
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9.69 example: の eg7 72C77O7 の な 


e Suppose の と and て と MW' Define : Vx W 一 F by の, の) ニ の (⑦) て (の ). 
Then is a bilinear functional on x WW. 


e Supposeo の and W.Defne B:"x W っ by (の , て ) = の (⑦) て (の ). 
Then J is a bilinear functional on "x W" 

es Define 8:VxV っ FEby の @, の) = @(⑦). Then p is a bilinear functional on 
Vx ぴ * 


e Suppose ゅ V. Define 8: ソ x ( ゆ ) っ F by 2(@, 了 了 ) = (7 の . Then is a 
bilinear functional on x 々 (). 


e Suppose77 and7 arepositive intesers. Define pi: FPPxFO と 7 っ Fby (4, ぢ ) = 
tr(45). Then 』 is a bilinear functional onF の Yx FE 


Proof Let e」,…,6。 be a basis of and 訪 ,……, 万 be a basis of W. For a bilinear 

functional 2 三 グ (V W), let 7(p) be the 娘 -by- ヵ matrix whose entry in row 7 

column is 放 e, 記 ). The map 2 ご (8) is a Hnear map of グ ( W) into F の 
ForamatrixC と TFP defime a bihinear functional 8- on Vx W by 


7 777 
(の dh の 2 も 2 記 ) ー 2 の Cg の 
ニ 1 / = 
for 9 っ の ビ F. 

The linear map pj 忠 77(5) from グ (V W) to F77 and the linear mapC 呈 pc 
from Fto グ (W) are inverses of each other because P ヵ rg, ニ Pfor al 
pg の (WW) and (8c) =Cfor alCEEF の 7 as you should verify. 

Thus both maps are isomorphisms and the two spaces that they connect have the 
same dimension. Hence dim グ (V W) = dimEF ダ テー 77 三 (dim )(dim W). 


Several different definitions of V@ MW appear in the mathematical literature. 
These definitions are equivalent to each other, at least in the finite-dimensional 
context。 because any two vector spaces Of the same dimension are isomorphic. 

The result above states that グ (V W) has the dimension that we seek, as do 
ZZ W) and EmYdmW Thus it may be tempting to define V ゅ W to be ク ( じ W) 
or の W) or FmVdimW 本 owever, none of those definitions would lead to a 
basis-free definitionofo@ oforo と Vandoe WMW. 

The following definition, while it may seem a bit stranse and abstract at first, 
has the huge advantage that it defines の @ の in a basis-free fashion. We define 
Ve@ W to be the vector space of bilinear functionals on V'x W' instead of the 
more tempting choice of the vector space of bilhinear functionals on x WW. 
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9.71 definiion: 7esor 7odc7 V@ Wo@o 


e The 7ezyor 7ogzc7 V@ MW is defined to be の (",W7). 


e Foro ゥ and 【W, the 7ezsyor p7 の gc7 の ⑳ の iS the element of V@ W 
defined by 


(の @ の ) (の, て) 三 の (の ) て (の の) 
for all (の , 7) と V'x W7 


We can quickly prove that the definition of V@ W gives it the desired dimension. 


9.72  Zg7777e727O72 の / 777e 7e725O7 7 の 77C7 の 7 カル の DeC7O7 の の C@y 


dim(V@ W) = (dim )(dim W). 


Proof Because a Vector space and its dual have the same dimension (by 3.111), 
we have mV' = manddinmW = dim W. Thus 9.70 tells us that the 
dimension of (PV",W”) equals (dim )(dim WW). 


To understand the definition of the tensor product o @ o of two vectors ヒレ 
and oo  W, focus on the kind of object it is. An element of V@ MW is a bihnear 
functional on V'x Wand in particular it is a function from "'x W' to F. Thus for 
each element of V'x W' it should produce an element of F. The definition above 
has this behavior, because の @ の applied to a typical element (の , て ) of V'x WI 
produces the number の (の ) て (の). 

The somewhat abstract nature of の @ の should not matter. The important point 
is the behavior of these objects. The next result shows that tensor products of 
Vectors have the desired bilinearity properties. 


9.73 7/77e77 カ の 7 7e77yO7 7 の 7/C7 


Suppose 6, 」, 6。 三 『 and の , の 」, の 。 古 WW and 和 ん 性 FE. Then 


(の 」 の) ⑳@ の の 」⑳⑦ の 十 の >⑳⑦ and の ⑳@( の ⑦」 十 の ⑦>) ニ の ⑳⑦⑳」 二 の ⑳⑱(⑦⑰> 


and 


ん (⑦ @ の ⑦) 三 (4 の ) @ の ニ の ⑳@ (AZ の ). 


Proof Suppose (の みて) と Vx WT Then 


(の ⑦」 + の ) @ ⑦)( の , て ) 三 の (の 」 二 の >) て (の ) 
三 の (の 1) て (の ) 十 の (の > ) て (の ) 
三 (の 」 @ の )( の , て ) 二 (の > @ の )( の , て ) 
三 (の 」 ⑳ の の > ⑳ の ⑦)( の , て). 


Thus (の 」+ の 2)@ の ニー ニ の 1@⑳ の の 2⑳ の . 
The other two equalities are proved similarly. 
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Lists are, by definition, ordered. The order matters when, for example, we 
form the matrix of an operator with respect to a basis. For Hists in this section 
with two indices, such as {e: @ 太 朋 ニュ た … ヵ Im the next result。 the ordering 
does not matter and we do not specify it 一 just choose any convenient ordering. 

The Hnear independence of elements of V@ MW in (a) of the result below 
captures the idea that there are no relationships among vectors in V@ 【W other 
than the relationships that come from bilinearity of the tensor product (see 9.73) 
and the relationships that may be present due to hnear dependence of a list of 
vectors in oralist of vectors in W. 


9.74 の gsy の V@ WW 


SuDDOse e], …, 6 1S a Hst of vectors in and 片 ,……, 訪 1S a Hst of vectors in W. 


(a) fg, …)e。 and 方 ,…, 訪 are both hnearly independent Hists, then 


{@: @ ルリ ニア の ンー 


is a hnearly independent list in @ MW. 


(b) TE g,…)e, 1S a basis of V and 方 ,.…, 万 iS a basis of W, then the Hst 
(e, @ ん 1 k=1.。 Sabasis ofV@ W. 


Proof Toprove (8), suppose e],…, 6 and 方 ,…, 方 are both hnearly independent 
Hists. This hnear independence and the Hnear map lemma (3.4) imply that there 
exist の ],…, の U' and て … て, ビ W” such that 

1 半 7 ニ ん 
0 王 / チ ん た 


1 計 7 ニ ん 
0 / チ ん 
where た 人 1,…,77) in the frst equation and 訪 た 人 1,…,7) in the second 


eduation. 
SuPDOSe 人 の, ニュ. 訪 : た =1.… ヵ 15 8 HSt of scalars such that 


9.75 b 2 の k(6@ 広 ) =0. 


た =17=1 


め (@) = | and て ( 太 ) = | 


Note that (@@ 所)( の uu, TA) eduals 1 / ニル and た = MA, and equals 0 otherwise. 
Thus applying both sides of 9.75 to (の 』, て TA) shows that 2 三 0, proving that 
(e@ ん 用 1 た = … ヵ 1S Hnearly independent. 

Now (b) follows from (8), the equation dimV@ W = (dim)(dim W) [see 
9.72], and the result that a Hinearly independent list of the right length is a basis 
(see 2.38). 


Every element of x W is a finite sum of elements of the form o @ op, where 
の と ando モ W, as implied by (b) in the result above. However, if dim ソ >1 
and dim W > 1, then Bxercise 4 shows that 


{o@ の : (の の ) モ VxW) チ Vew WMW. 
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9.76 example: 7e7yO7 7 の dc7 の げ e/e7ze777 の 7 F7 7 e/e7ze77 の FE7 


SuDpOose 77 and 7 are DoOsitive integers. Let e」, .……,6, denote the standard basis 
ofF7 and let ,…, ん denote the standard basis ofF* Suppose 


の 三 (の … っ の) FE" and の 三 (の …。 の) F". 


Then 


777 7 


vew=( yg)e( 》 w た ) 


7=1 た =1 
= ッ 2 〉2 (の の 0@@ 訳 . 


Thus with respect to the basis (e @ 太 才 1 た.。 OfTFY @F provided 
by 9.74(b), the coefhcients ofo @ op gre the numbers (の の J/ ニ ュ 、 訪 た =1.… か 
instead of writing these numbers in a Hist, we write them in an 77-by-7 matrix with 


の の in TOW 7, column た then We can identify o @ 7 の With the 7-bY-7 matrix 


の の 1 の の の 。 


の の ーー の 人 の 


See Exercises $ and 6 for practice in using the identification from the example 
above. 

We now define bilinear maps, which differ from bilinear functionals in that 
the target space can be an arbitrary vector space rather than just the scalar field. 


9.77 gefinition: の 7/777eg7 777 の の 


A eg7 7 の の from レ x W to a Vector space Uisafunctonl:VxW っ 


such that の ら T( の の ) is a hnear map from toUforeachoー Wand 
の T( の , の) is a hnear map from W to for eacho と と 


9.78 example: 7777e27 7 の の y 


e Every bilinear functional on x W is a bilinear map from x W to F. 


e Thefunctiionl:VxW っ VewMWdefmed by To の, の) = の @ の is a bilinear map 
from x W to Ve@ W (by 9.73). 

e The functionT : ん (") x ん () っ 々 ( ぴ ) defned by T(5, 了 7) = 5 ア is a bilinear 
map from 々 ( ぴ ) x 々 ( ぴ ) to 々 ( ぴ ). 

e The functiion1: ソ x ン (W) っ W defned by T(@, 了 ア ) = 7? is a bilinear map 
from Vx (WW) to W. 
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Tensor products alloW us to convert bilinear maps on x W into Hinear maps on 
V@ W (and vice versa), as shown by the next result. In the mathematical literature, 
(a) of the result below is called the “universal property” of tensor products. 


9.79 co7zve7772g /7/777e27 777 の 5 7 の 7777647 777 の の ゞ 


Suppose (is a Vector SDace. 


(8) SupposeT: Vx W っ Uisabilinear map. Then there exiStS a unidue 
inear mapI:V@W っ Usuch that 


T(o @ の ⑦) 三 (の, の ) 


for all (?, の ) と Vx MW 


(b) Conversely, suppose 了 : V@ W っ Uisa Hmnear map. There there exists a 
unique bilinear map 7f『: VxW っ 太 suchthat 


7#( の の ) ニア (o ⑳ の ) 


for all (?, の ) と Ex IMW 


Proof Lete」,…,e。 beabasis of and let 方 , ……, 万 be a basis of W. By the linear 
map lemma (3.4) and 9.74(b), there exists a unique hnear map Ti:VgW っ つっ 
Such that _- 
Te @ 刻 ) =T(@,, 太 ) 
for all 7 人 1,.…, 罰 ) and た 1, …, 7 
Now suppose (の , の ) と x W. There exist 41,… のり, …, ち 。 三 F such that 
の = ニ の 年 キー の 6。 andg = 方 キー ナル ん . Thus 


To @ の ) 三 6 う >。 5 (@)(@ @ 記 ) 
を = ニ 17 ニ 1 


= う 2 〉 giTee 応 


k ニ 17=1 


7 777 


= 2 2〉 gpT(e。 が 


た =17=1 
ニ T( の , の ), 


as desired, where the second line holds because Tis jinear, the third Hine holds by 
the definition of 際 and the fourth line holds becauseT is bilinear. 

The uniqueness of the Hinear map 1 satisfying 1(? @ の ) = T( の , の ) follows 
from 9.74(b), completings the proof of (8@). 

To prove (b), define a function 7*: VxW っ by 7 の の ) = 7T( の @ の ) for all 
(の , の ) と x IMW. The bilinearity of the tensor product (see 9.73) and the hnearity 
of7imply that 7# is bilinear. 

Clearly the choice of 7『 that satisfies the conditions is unique. 
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To prove 9.79(a), we could not just define T(o @⑳ の) ニ T( の , の ) for allo の とげ ど 
and ヒモ MW (and then extend T linearly to all of V@ W) because elements of 
Ve@ W do not have unique representations as finite sums of elements of the form 
oc@ の. Ourproofusedabasis of and a basis of W to get around this problem. 

Although our construction of T in the proof of 9.79(a) depended on a basis of 
V and a basis of W the equation T(o @⑳ の ) ニ 1(?, の ) that holds for all の と and 
の  W shows that T does not depend on the choice of bases for "and W'. 


76775O7 7Og7/C7 o/ 77777e7 /7 の 7/C7 SD の Ce6y 


The result below features three inner products--one on V@ W, one on and one 
on 【W, although we use the same symbol (, ・) for all three inner products. 


9.80 772@7 7Og7/C7 77 76729O7 7 の 74C7 O7 の 7777267 の 7 の 77C7 5 の C@y ゞ 


Suppose V and 【W are inner product spaces. Then there iS a unique inner 
product on V@ MW such that 


(《⑦ @ の ⑦, 7 ⑳ ) 三 (の , 2)《 の , ) 


forallo,z andzpy 古 MW. 


Proof Suppose 6」,…,6。 1S an orthonormal basis of and 方 ,…, 訪 1S an ortho- 
normal basis of W. Define an inner product on V@ W by 
7 777 7 777 7 777 
9.81 2 2 か kg@ 記 2 2 or99 ん ) 2 
を = ニ 17 ニ 1 を = ニ 17 ニ 1 た =17=1 
The straightforward verification that 9.81 defines an inner product on Vx W 
is left to the reader |use 9.74(b) | 


Supposethatoz 三 リ ande,y W. Leto,…,o。 と F be such that 


の = の 6 キ … キ の 6 With similar expressions for の , and *. Then 


777 7 777 7 
〈⑦ @ の, ⑳ Y) ニ (* の gg@ 2 た 2 4 の 9 2 w) 
7 ニュ =1 7 ニ 1 =1 


7 


7 777 777 
(* 9 の の の 6 太 b 生 当 7 の 4 
=17=1 =1 


た ニ 17 


I I 
トド 

、S 

| 

S 

は 

了 


| 
7ー YS 
は 
昌 ミ き 
由 
ヘー ン 
ンー で 
そ 
さき 
呈 
S 
PS 
ざき 
式 
ヘー ン 


三 (の , 7)( の , Y). 


There is only one inner product on V@ W such that (の ⑳z の , 7⑳Y) 三 (の , 4)(⑦, ) 
for all o, な and の, W because every element of V@ W can be written as 
a linear combination of elements of the formo@ow [by 9.74(b)]. 
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The definition below of a natural inner product on V@ W is now justified by 
9.80. We could not have simply defined (の @ op, @ *) to be (の , の (の, Y) (and then 
used additivity in each slot separately to extend the definition to V@ W) without 
some proof because elements of V@ MW do not have unique representations as 
fimite sums of elements of the formo@ 6 の . 


9.82 definition: 7 が 67 7 の gzzC7 72 7677?O7 の 7 の の 7zC7 の 7 の 727267 7 の 77C7 5 の DC@S 


Suppose " and W are inner product spaces. The inner product on V@ Wis 
the unique function (-,・) from (V@ W) x (V@ W) to F such that 


(の @ の ,7 ⑳) 三 (の 7 の (の ,) 


for alloj ヒ and zo MW. 


Takez = ニ ゥ andx ニ = の inthe equation above and then take square roots to 
show that 
lg@ | =|gll 


forall の と andaleeMW. 

The construction of the inner product in the proof of 9.80 depended on an 
orthonormal basis e」, …,6, Of and an orthonormal basis 方 , .…, 記 Of W. Formula 
9.81implies that ( ら @ ん 1 … ヵ 1S 8 doubIy indexed orthonormal list m 
Ve W and hence is an orthonormal basis of V@ W [by 9.74(b)]. The importance 
of the next result arises because the orthonormal bases used there can be different 
from the orthonormal bases used to define the inner product in 9.80. Althoush 
the notation for the bases is the same in the proof of 9.80 and in the result below, 
think of them as two different sets of orthonormal bases. 


9.83 o7 娘 o77o77727 の gs7y の 7 V@ W 


Suppose V and W are inner product spaces, and e」, .…, 6 1S an orthonormal 
basis of and 訪 ,…, ん 1S an orthonormal basis of W. Then 


(の @ ニュ な = ュ 


is an orthonormal basis of V@ W. 


Proof Weknowthatte@ 太 及 =. 計 た = 1Sa basis of V@ W [by 9.74(⑥b)| 
Thus we only need to verify orthonormality. To do this, suppose 7, Af 人 1,…,77} 
and ん た , ME {1,.…, 7 Then 


@@ ん,e @ 訪 4) ニ (@,eN が (た 訪 ) テ | 


Hence the doubly indexed Hist (e @ ん 1 訪 : た =1… ヵ 15 Indeed an orthonormal 
basis of Ve W. 


1 下 7 ニ Mand た = ル AL 


0 otherwise. 


See Exercise 11 for an example of how the inner product structure on V@ W 
interacts with operators on and W. 
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7e77sO7 7og7/c7 o/ 777777 の /e Vec7o7 Spcey 


We have been discussing propertes of the tensor product of two finite-dimensional 
vector spaces. Now we turn our attention to the tensor product of multiple finite- 
dimensional vector spaces. This generalization reduires no new ideas, Only some 
slightly more complicated notation. Readers with a good understanding of the 
tensor product of two vector spaces should be able to make the extension to the 
tensor product of more than two vector spDaceS. 

Thus in this subsection, no proofs will be provided. The definitions and the 
statements of results that will be provided should be enough information to enable 
readers to il in the details, using what has already been learned about the tensor 
product of two vector SDaceS. 

We begin with the following notational assumption. 


9.84 notation: 攻 ,… 


For the rest of this subsection, 77 denotes an integer greater than 1 and 
必 ,…, し , denote fimite-dimensional Vector sDaces. 


The notion of an 77-Hinear functional, which we are about to define, generalizes 
the notion of a bilinear functional (see 9.68). Recall that the use of the word 
“functional'” indicates that we are mapping into the scalar field F. Recall also that 
the terminology “7p-Hnear form'" is used in the special case ニー ニテ ツリ, (See 
9.25). The notation グ ( 監 ,……,,) generalizes our previous notation 少 ( ソ W). 


9.85 definition: 77-/7eg7 72c7O77, 77e vec7o7 y の gce (WV,… /。) 


e An 77-/7eg7 72c77 の 777 om 六 x…xV isafunctionB: 罰 xx…x ル アーE 
that is a linear functional in each slot when the other slots are held fixed. 


e The vector space of 77-Hnear functionals on xx…x is denoted by 
の UDBe UE 


9.86 example: 77-/77eg7 477C77O76/ 


Suppose の (区) for each 代 ,…, 嫌 ). Defne pi x…x ア っ ーFby 


の (の, っ の,) 三 の 1( の ]) XX の 放 ( の 。)・ 
Then pis an 刀 -Hnear functional on x…ーx ル 


The next result can be proved by imitating the proof of 9.70. 


9.87 g7777e747O77 の 7 777e vec7O7 SDGCe の / 77-/777e の 7 7777C77O72/ ゞ 


dm グ (,… し ) = (dm 必 ) x … x (dim / ). 
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Now we can define the tensor product of multiple vector spaces and the tensor 
product of elements of those vector spaces. The following definition is completely 
analogous to our previous definition (9.71) in the case 77 = 2. 


9.88 definition: 7e7yO7 7 の dc7 6@…@6 WV, の 0 の 16 …⑳ の 』 


es The 7e7yo7 p7ogdzo7 6@…⑳V, is defned to be の ( 四 ,…). 


e PFor?」 古 引 ,… の と,, the 7e72yO7 の 7 の の 7 の 」⑳ … ⑳ の ,。 1S the element 
of 久 @…@ レ PV, defned by 


(の @…@⑳ の の (の の) 三 の (の)… の (の ) 
osalll(2 生 の IM Xu xv/ 


The next result can be proved by following the pattern of the proof of the 
analogous result when 77 三 2 (see 9.72). 


9.89 Zg777ze727O77 の / 777e 7725O7 の 7 の 77C7 


dm( 作 @…@) = (dm 区 )…(dm/). 


Our next result generalizes 9.74. 


9.90 の pgss の 必 @…@ ゆ の 


Suppose dim = 7 and 本 .1S a basis of for た = 1,…,77. Then 


M 7 
(@ @…@ の = ュ 


isabasisof@…@9V. 

Suppose 好 三 2andg 生 giSabasis of Vi and 本 の Sa basis of の . 
Then with respect to the basis ( 緒 (が) の 1 1 TH (the result above, the 
coe 抽 cients of an element of @ ゆ can be represented by an 7」-by- ヵ 。 matrix that 
contains the coefcient of に ) の in row 刻 , column ヵ . Thus we need a matriX, 
which is an array specified by two indices, to represent an element of @ ゆ の. 

Tf 7 > 2, then the result above shows that we need an array specified by 7 
indices to represent an arbitrary element of り @…@⑬ ツ V,. Thus tensor products 
may appear when we deal with objects specified by arrays with multple indices. 

The next definition generalizes the notion of a bilhinear map (see 9.77). As 
with biliinear maps, the target space can be an arbitrary Vector sDace. 


9.91 definilion: 如 -/eg7 7 が の 


An 77-7772eg7 7 の の from 中 x…x メ アツ, to avector space is a fanction 


Ti xx…x レ っ that is a Hinear map in each slot when the other slots are 
held fixed. 
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The next result can be proved by following the pattern of the proof of 9.79. 


9.92 co7zve7777g 77-/77767 7 の S 7 の 777767 7777 の 5 


SuDDOSe (1S a Vector SDace. 


(a) SupposethatT: xx…ーx レ レー UiS an 如 -Himear map. Then there exists 
aunique linearmapl: 必 6@…@ し っ Usuchthat 


IM ⑳…@⑳ の 』) ニ T( の 」,…, の 。) 


for al (@,… 6) メール. 


(b) Conversely, suppose 了 : 攻 @…@ り りつ Uis aa Hmear map. There there 
exists a unique 7 が -Hinear map 7f: メー アー such that 


UN の OO 0ー UUONO の の 


for al の,… の) メー ルル. 


See Bxercises 12 and 13 for tensor products of multiple inner product spaces. 


re7czyey のり 


1 Suppose の と andwMW.Provethato@ の =0ifandonlyifo=0or 
の =0. 
2 Give an example of six distinct vectors o」, の >, の 3, の 1, の っ 。 の in R? such that 
の ]⑳ の 」 二 の っ 2⑳@ の >。 十 の s⑳ の 。 三 0 


but none of o」 ⑳ 7 の, の > ⑳ の っ , の 3 ⑳ の 。 1S a Scalar multiple of another element 
of this list. 


3 Suppose that の 」,…, 6 15 a hnearly independent Hist in Suppose also that 


っ の 。 
の ],…, の 1S a Hist in W such that 


の 1@ の 」 キ … オ の ⑳ の 0. 
Prove that」 ニ ーー の =0. 
4 Suppose dimV > 1 and dim W > 1. Prove that 
{o@ の: (の の ) Ex WI 


is not a subspace of V@ W. 
777y exe7c75e 7 の 77ey 7 の 7 が dm ザッ > 1 gd dim W > 1 7 娘 e7 


{o@ の : (の の ) モ と VxW) チ VewW. 


10 


11 


12 
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Suppose 77 and 7 are positive integers. Foro 三 F" andoF",identify 
の @ の with an 77-by-7 matrix as in Example 9.76. With that identification, 
show that the set 

{o@ew:o と TP7ando と TP 


is the set of 娘 -by-7 matrices (with entries in F) that have rank at most one. 


Suppose 77 and 77 are positive integers. Give a description, analogous to 
Exercise 3, of the set of 77-by-7 matrices (with entries in F) that have rank 
at most tWO. 


Suppose dimV > 2 and dim W > 2. Prove that 
{の o」@ の ⑦」+ の ⑳ の >: の の ビリ and の の W) チ V@ WI 
SupDose の ],…, の 。 ビリ and の] …, の W are such that 
の 」⑳ の キオ … オ ナオ の,⑳ の / ニ 0. 


Suppose that is a Vector space andT: VxW っ isabiliinear map. Show 
that 
T( の 1, の 1) キキ 1 で の) 三 0. 
Suppose 5 々 ( じ ) and ア 7 ん (W). Prove that there exists a unique Operator 
on V@ Wthattakeso@wto 5 の @ 了 の forallo の とり amd と W. 
7 7 9 の 4ye の 7 7 の 7777O7, 7e Ope7 の 7 の 7 の 7 V@ 【W gre7 か 万 信 ere7c7ye 75 


o7e7 cg7/e7 5 @ 務 


Suppose 5 々 () and7 と ん (W). Prove that 5@7is an invertible operator 
onV@ Wifand onlyboth Sand 了 are invertible operators. Also, prove 
that if both 5 and 7 are invertible operators, then (6 @7)-「 =5-「@ ぁ 7ー)」 
where we are using the notation from the comment after Exercise 9. 


Suppose V and W are inner product spaces. Prove that i 5 々 ( じ ) and 
了 と /(W),then (6 @7)* ニ 56Y@7? where we are using the notation from 
the comment after Exercise 9. 


Suppose that ,…, し , are fimite-dimensional inner product spaces. Prove 
that there is a unique inner product on V」 @ …@V, such that 


(の で 9 …⑳ の 2 ⑳9 …⑳7。) (の 1 ) (の) 7 


for al (の,… の) and ( 生 ,」… 4 mn メー メリ 


oe 娘 47 77e e7477O7 @ の ove 777 の 7ey 7 
Io @⑳…⑳@ る 三 lgil らく 3 I2 請 | 


7 7 (の …。 の) モール 
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Suppose that ,…,, are fimite-dimensional inner product spaces and 
必 @…@, is made into an inner product space using the inner product 
from Exercise 12. Suppose ef … is an orthonormal basis of ルル for each 
ん = 1, .…, 娘 . Show that the list 


5 


is an orthonormal basis of 引 @…@ り 。. 


アア /o7O C7e77 が な 
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